Sep 16 10:57:22 devstack cinder-volume[75611]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 16 10:57:22 devstack cinder-volume[75611]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 16 10:57:22 devstack cinder-volume[75611]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 16 10:57:24 devstack cinder-volume[75611]: INFO dbcounter [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Registered counter for database cinder
Sep 16 10:57:24 devstack cinder-volume[75611]: DEBUG oslo_db.sqlalchemy.engines [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 16 10:57:24 devstack cinder-volume[75611]: DEBUG dbcounter [-] [75611] Writer thread running {{(pid=75611) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 16 10:57:24 devstack cinder-volume[75611]: INFO cinder.rpc [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 10:57:24 devstack cinder-volume[75611]: INFO cinder.rpc [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 10:57:24 devstack cinder-volume[75611]: DEBUG oslo_db.sqlalchemy.engines [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 16 10:57:24 devstack cinder-volume[75611]: INFO cinder.volume.manager [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Determined volume DB was empty at startup.
Sep 16 10:57:24 devstack cinder-volume[75611]: DEBUG cinder.volume.manager [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75611) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 16 10:57:24 devstack cinder-volume[75611]: INFO cinder.volume.manager [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 16 10:57:24 devstack cinder-volume[75611]: WARNING stevedore.named [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 10:57:24 devstack cinder-volume[75611]: WARNING castellan.key_manager [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 10:57:24 devstack cinder-volume[75611]: WARNING cinder.keymgr.conf_key_mgr [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 10:57:24 devstack cinder-volume[75611]: DEBUG cinder.volume.drivers.lvm [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75611) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 16 10:57:24 devstack cinder-volume[75611]: DEBUG oslo_concurrency.processutils [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:25 devstack cinder-volume[75611]: DEBUG oslo_concurrency.processutils [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] CMD "cinder-rtstool verify" returned: 0 in 1.038s {{(pid=75611) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_db.sqlalchemy.engines [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 16 10:57:26 devstack cinder-volume[75611]: INFO cinder.rpc [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 16 10:57:26 devstack cinder-volume[75611]: INFO cinder.rpc [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 16 10:57:26 devstack cinder-volume[75611]: WARNING stevedore.named [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 10:57:26 devstack cinder-volume[75611]: WARNING castellan.key_manager [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 10:57:26 devstack cinder-volume[75611]: INFO cinder.volume.manager [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_db.sqlalchemy.engines [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 16 10:57:26 devstack cinder-volume[75611]: INFO oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Starting 1 workers
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Started child 75768 {{(pid=75611) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Full set of CONF: {{(pid=75611) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] ******************************************************************************** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Configuration options gathered from: {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] ================================================================================ {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] allow_availability_zone_fallback = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] allow_compression_on_image_upload = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] allowed_direct_url_schemes     = [] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] api_rate_limit                 = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] auth_strategy                  = keystone {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] az_cache_duration              = 3600 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_availability_zone      = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_host                   = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_name                   = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_stats_polling_interval = 60 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backup_api_class               = cinder.backup.api.API {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backup_name_template           = backup-%s {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backup_use_same_host           = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backup_use_temp_snapshot       = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] chap_password                  = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] chap_username                  =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cinder_internal_tenant_project_id = c6cf7a37268c444ca804e4c44940928d {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cinder_internal_tenant_user_id = 8aba1a6508ac45e08134601e0e3a9ba5 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cloned_volume_same_az          = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cluster                        = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] compression_format             = gzip {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] compute_api_class              = cinder.compute.nova.API {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] config_dir                     = [] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] config_source                  = [] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] control_exchange               = openstack {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] debug                          = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] default_availability_zone      = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] default_group_type             = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] default_volume_type            = lvmdriver-1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] driver_client_cert             = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] driver_client_cert_key         = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] driver_data_namespace          = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] driver_ssl_cert_path           = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] driver_ssl_cert_verify         = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] driver_use_ssl                 = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] enable_force_upload            = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] enable_new_services            = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] enable_unsupported_driver      = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] enforce_multipath_for_image_xfer = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] filter_function                = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] glance_api_insecure            = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] glance_api_servers             = ['http://192.168.122.148/image'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] glance_api_ssl_compression     = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] glance_ca_certificates_file    = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] glance_catalog_info            = image:glance:publicURL {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] glance_certfile                = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] glance_keyfile                 = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] glance_num_retries             = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] glance_request_timeout         = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] goodness_function              = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] graceful_shutdown_timeout      = 5 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75768]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.1)
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] group_api_class                = cinder.group.api.API {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] host                           = devstack {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] image_compress_on_upload       = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] image_conversion_address_space_limit = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] image_conversion_cpu_limit     = 60 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] image_conversion_disable       = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] image_upload_use_cinder_backend = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] image_upload_use_internal_tenant = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] image_volume_cache_enabled     = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] image_volume_cache_max_count   = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] image_volume_cache_max_size_gb = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] init_host_max_objects_retrieval = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] instance_format                = [instance: %(uuid)s]  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] iscsi_iotype                   = fileio {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] iscsi_target_flags             =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] iscsi_write_cache              = on {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] iser_helper                    = tgtadm {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] iser_ip_address                = 192.168.122.148 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] iser_port                      = 3260 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] log_color                      = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] log_config_append              = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] log_dir                        = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] log_file                       = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] log_options                    = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] log_rotate_interval            = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] log_rotate_interval_type       = days {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] log_rotation_type              = none {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] max_age                        = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] max_logfile_count              = 30 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] max_logfile_size_mb            = 200 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] max_over_subscription_ratio    = 20.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] message_reap_interval          = 86400 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] message_ttl                    = 2592000 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] migration_create_volume_timeout_secs = 300 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] monkey_patch                   = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] monkey_patch_modules           = [] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] my_ip                          = 192.168.122.148 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] no_snapshot_gb_quota           = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] num_iser_scan_tries            = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] num_shell_tries                = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] num_volume_device_scan_tries   = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] nvmeof_conn_info_version       = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] nvmet_ns_id                    = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] nvmet_port_id                  = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] osapi_max_limit                = 1000 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] osapi_volume_ext_list          = [] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] osapi_volume_listen_port       = 8776 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] osapi_volume_use_ssl           = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] osapi_volume_workers           = 2 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] per_volume_size_limit          = -1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] periodic_fuzzy_delay           = 60 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] periodic_interval              = 60 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] public_endpoint                = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] publish_errors                 = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] quota_backup_gigabytes         = 1000 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] quota_backups                  = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] quota_gigabytes                = 1000 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] quota_groups                   = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] quota_snapshots                = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] quota_volumes                  = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] rate_limit_burst               = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] rate_limit_except_level        = CRITICAL {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] rate_limit_interval            = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] reinit_driver_count            = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] replication_device             = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] report_discard_supported       = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] report_interval                = 120 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] reservation_clean_interval     = 86400 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] reservation_expire             = 86400 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] reserved_image_namespaces      = [] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] reserved_percentage            = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] rpc_response_timeout           = 120 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] run_external_periodic_tasks    = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] scst_target_driver             = iscsi {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] scst_target_iqn_name           = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_down_time              = 720 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] shell_completion               = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] snapshot_name_template         = snapshot-%s {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] snapshot_same_host             = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] split_loggers                  = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] state_path                     = /opt/stack/data/cinder {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] storage_availability_zone      = nova {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] storage_protocol               = iSCSI {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] syslog_log_facility            = LOG_USER {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] target_helper                  = lioadm {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] target_ip_address              = 192.168.122.148 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] target_port                    = 3260 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] target_protocol                = iscsi {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] target_secondary_ip_addresses  = [] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] trace_flags                    = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] transport_url                  = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] until_refresh                  = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] use_chap_auth                  = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] use_default_quota_class        = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] use_journal                    = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] use_json                       = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] use_multipath_for_image_xfer   = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] use_stderr                     = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] use_syslog                     = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] verify_glance_signatures       = enabled {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_api_class               = cinder.volume.api.API {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_backend_name            = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_clear                   = zero {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_clear_ionice            = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_clear_size              = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_copy_bps_limit          = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_dd_blocksize            = 1M {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_name_template           = volume-%s {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_service_inithost_offload = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volume_usage_audit_period      = month {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] watch_log_file                 = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] zoning_mode                    = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_concurrency.disable_process_locking = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.admin_password = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.admin_token = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.admin_user  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.auth_port   = 35357 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.auth_protocol = https {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.auth_section = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.auth_type   = password {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.auth_uri    = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.auth_version = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.cache       = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.certfile    = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.delay_auth_decision = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.http_connect_timeout = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.identity_uri = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.include_service_catalog = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.insecure    = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.interface   = public {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.keyfile     = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_password =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcache_username =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.region_name = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.service_token_roles_required = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.service_type = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.token_cache_time = 300 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.backend                  = dogpile.cache.null {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.backend_argument         = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.backend_expiration_time  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.config_prefix            = cache.oslo {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.dead_timeout             = 60.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.debug_cache_backend      = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.enable_retry_client      = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.enable_socket_keepalive  = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.enabled                  = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.enforce_fips_mode        = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.expiration_time          = 600 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.hashclient_retry_attempts = 2 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.memcache_dead_retry      = 300 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.memcache_password        = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.memcache_pool_maxsize    = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.memcache_sasl_enabled    = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.memcache_username        = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.proxies                  = [] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.redis_db                 = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.redis_password           = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.redis_sentinel_service_name = mymaster {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:26 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.redis_server             = localhost:6379 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.redis_socket_timeout     = 1.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.redis_username           = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.retry_attempts           = 2 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.retry_delay              = 0.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.socket_keepalive_count   = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.socket_keepalive_idle    = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.socket_keepalive_interval = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.tls_allowed_ciphers      = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.tls_cafile               = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.tls_certfile             = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.tls_enabled              = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cache.tls_keyfile              = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] coordination.backend_url       = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.asyncio_connection    = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.asyncio_slave_connection = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.backend               = sqlalchemy {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.connection            = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.connection_debug      = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.connection_parameters =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.connection_recycle_time = 3600 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.connection_trace      = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.db_inc_retry_interval = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.db_max_retries        = 20 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.db_max_retry_interval = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.db_retry_interval     = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.max_overflow          = 50 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.max_pool_size         = 5 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.max_retries           = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.mysql_wsrep_sync_wait = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.pool_timeout          = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.retry_interval        = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.slave_connection      = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.sqlite_synchronous    = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] database.use_db_reconnect      = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.connection_string     = messaging:// {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.enabled               = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.es_doc_type           = notification {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.es_scroll_size        = 10000 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.es_scroll_time        = 2m {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.filter_error_trace    = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.hmac_keys             = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.sentinel_service_name = mymaster {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.socket_timeout        = 0.1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.trace_requests        = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler.trace_sqlalchemy      = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler_jaeger.process_tags   = {} {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler_jaeger.service_name_prefix = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] profiler_otlp.service_name_prefix = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.enforce_new_defaults = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75768]: INFO cinder.volume.manager [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 16 10:57:27 devstack cinder-volume[75611]: WARNING oslo_config.cfg [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.enforce_scope      = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.policy_default_rule = default {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.policy_file        = policy.yaml {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] privsep_osbrick.group          = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] privsep_osbrick.helper_command = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] privsep_osbrick.user           = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cinder_sys_admin.group         = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cinder_sys_admin.helper_command = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] cinder_sys_admin.user          = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_user.auth_section      = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_user.auth_type         = password {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_user.certfile          = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_user.collect_timing    = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_user.insecure          = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_user.keyfile           = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_user.send_service_user_token = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_user.split_loggers     = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] service_user.timeout           = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.backend_availability_zone = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.chap_password = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.chap_username =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.driver_client_cert = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.driver_client_cert_key = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.driver_data_namespace = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.driver_use_ssl = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.enable_unsupported_driver = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.extra_capabilities = {} {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.filter_function = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.goodness_function = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.iscsi_iotype  = fileio {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.iscsi_target_flags =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.iscsi_write_cache = on {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.iser_helper   = tgtadm {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.iser_port     = 3260 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.lvm_share_target = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.lvm_type      = auto {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.num_shell_tries = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.nvmet_port_id = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.replication_device = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.report_discard_supported = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.reserved_percentage = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.scst_target_driver = iscsi {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.scst_target_iqn_name = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.storage_protocol = iSCSI {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.target_helper = tgtadm {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.target_port   = 3260 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.target_protocol = iscsi {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.trace_flags   = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.unique_fqdn_network = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.use_chap_auth = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.volume_backend_name = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.volume_clear  = zero {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.volume_clear_ionice = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.volume_clear_size = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_reports.file_event_handler = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_reports.log_dir           = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.backend_availability_zone = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.backend_host       = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.chap_password      = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.chap_username      = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.driver_client_cert = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.driver_data_namespace = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.extra_capabilities = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.filter_function    = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.goodness_function  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.iscsi_iotype       = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.iser_helper        = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.iser_ip_address    = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.iser_port          = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.iser_target_prefix = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.lvm_share_target   = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.lvm_type           = auto {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.num_shell_tries    = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.replication_device = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.report_discard_supported = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.reserved_percentage = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.scst_target_driver = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.storage_protocol   = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.target_helper      = lioadm {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.target_ip_address  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.target_port        = 3260 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.190s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.trace_flags        = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.use_chap_auth      = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.volume_clear       = zero {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.volume_clear_size  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] lvmdriver-1.volumes_dir        = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.ssl      = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_notifications.driver = [] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_notifications.retry = -1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] oslo_messaging_notifications.transport_url = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] key_manager.fixed_key          = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.barbican_api_version  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.barbican_endpoint     = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.barbican_endpoint_type = public {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.barbican_region_name  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.cafile                = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.certfile              = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.collect_timing        = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.insecure              = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.keyfile               = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.number_of_retries     = 60 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.retry_delay           = 1 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.send_service_user_token = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.split_loggers         = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.timeout               = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.verify_ssl            = True {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican.verify_ssl_path       = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican_service_user.auth_section = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican_service_user.auth_type = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican_service_user.cafile   = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican_service_user.certfile = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican_service_user.collect_timing = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican_service_user.insecure = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican_service_user.keyfile  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican_service_user.split_loggers = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] barbican_service_user.timeout  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.approle_role_id          = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.approle_secret_id        = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.kv_mountpoint            = secret {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.kv_path                  = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.kv_version               = 2 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.namespace                = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.root_token_id            = **** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.ssl_ca_crt_file          = None {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.timeout                  = 60.0 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.use_ssl                  = False {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 10:57:27 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] ******************************************************************************** {{(pid=75611) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 16 10:57:27 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.126s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:27 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:27 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.104s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:27 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:27 devstack sudo[75839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 16 10:57:27 devstack sudo[75839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:29 devstack sudo[75839]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:29 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 1.991s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:29 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:29 devstack sudo[75942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 10:57:29 devstack sudo[75942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:31 devstack sudo[75942]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:31 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.967s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:31 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 10:57:31 devstack cinder-volume[75768]: INFO cinder.brick.local_dev.lvm [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 16 10:57:31 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:31 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.079s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:31 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:31 devstack sudo[76050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 10:57:31 devstack sudo[76050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:33 devstack sudo[76050]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:33 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.978s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:33 devstack cinder-volume[75768]: DEBUG cinder.brick.local_dev.lvm [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75768) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 16 10:57:33 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:33 devstack sudo[76142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 10:57:33 devstack sudo[76142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:36 devstack cinder-volume[75611]: DEBUG dbcounter [-] [75611] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75611) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 10:57:38 devstack sudo[76142]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:38 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 4.881s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:38 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:38 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.108s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:38 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:38 devstack sudo[76346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 10:57:38 devstack sudo[76346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:40 devstack sudo[76346]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:40 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.003s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:40 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:41 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.171s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:41 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:41 devstack sudo[76385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 16 10:57:41 devstack sudo[76385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:43 devstack sudo[76385]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:43 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.632s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:43 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:43 devstack sudo[76438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 10:57:43 devstack sudo[76438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:46 devstack sudo[76438]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:46 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.508s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:46 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:46 devstack sudo[76446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 10:57:46 devstack sudo[76446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:49 devstack sudo[76446]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:49 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.829s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:49 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:49 devstack sudo[76449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 10:57:49 devstack sudo[76449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:51 devstack sudo[76449]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:51 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.189s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:51 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:51 devstack sudo[76454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 10:57:51 devstack sudo[76454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:53 devstack sudo[76454]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:53 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.328s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:53 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:53 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.088s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:53 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:53 devstack sudo[76535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 10:57:53 devstack sudo[76535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:56 devstack sudo[76535]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:56 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.217s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:56 devstack cinder-volume[75768]: INFO cinder.volume.drivers.lvm [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 16 10:57:56 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:56 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:56 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:56 devstack sudo[76648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 10:57:56 devstack sudo[76648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:57:58 devstack sudo[76648]: pam_unix(sudo:session): session closed for user root
Sep 16 10:57:58 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.955s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:57:58 devstack cinder-volume[75768]: DEBUG cinder.volume.drivers.lvm [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Updating volume stats {{(pid=75768) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 16 10:57:58 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:57:58 devstack sudo[76756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 10:57:58 devstack sudo[76756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:00 devstack sudo[76756]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:00 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.972s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:00 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:00 devstack sudo[76759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 10:58:00 devstack sudo[76759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:02 devstack sudo[76759]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:02 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.132s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:02 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:02 devstack sudo[76764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 10:58:02 devstack sudo[76764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:04 devstack sudo[76764]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:04 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.873s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:04 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:04 devstack sudo[76768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 10:58:04 devstack sudo[76768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:06 devstack sudo[76768]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:06 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.919s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:06 devstack cinder-volume[75768]: INFO cinder.volume.driver [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 10:58:06 devstack cinder-volume[75768]: DEBUG cinder.volume.driver [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75768) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:844}}
Sep 16 10:58:06 devstack cinder-volume[75768]: DEBUG oslo_db.sqlalchemy.engines [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75768) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 16 10:58:06 devstack cinder-volume[75768]: DEBUG dbcounter [-] [75768] Writer thread running {{(pid=75768) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 16 10:58:06 devstack cinder-volume[75768]: DEBUG cinder.db.sqlalchemy.api [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Building query based on filter {{(pid=75768) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 16 10:58:06 devstack cinder-volume[75768]: DEBUG cinder.image.image_utils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75768) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 16 10:58:06 devstack cinder-volume[75768]: INFO cinder.keymgr.migration [None req-5ab82498-a631-407a-8ec9-0f55584ee171 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 10:58:06 devstack cinder-volume[75768]: DEBUG cinder.volume.drivers.lvm [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Updating volume stats {{(pid=75768) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 16 10:58:06 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:07 devstack sudo[76802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 10:58:07 devstack sudo[76802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:09 devstack sudo[76802]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:09 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.442s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:09 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:09 devstack sudo[76918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 10:58:09 devstack sudo[76918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:11 devstack sudo[76918]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:11 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.251s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:11 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:11 devstack sudo[76921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 10:58:11 devstack sudo[76921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:13 devstack sudo[76921]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:13 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.078s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:13 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:13 devstack sudo[76924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 10:58:13 devstack sudo[76924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:16 devstack sudo[76924]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:16 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.518s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:16 devstack cinder-volume[75768]: DEBUG cinder.manager [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Notifying Schedulers of capabilities ... {{(pid=75768) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 10:58:16 devstack cinder-volume[75768]: INFO cinder.volume.manager [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Driver initialization completed successfully.
Sep 16 10:58:16 devstack cinder-volume[75768]: INFO cinder.manager [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Initiating service 2 cleanup
Sep 16 10:58:16 devstack cinder-volume[75768]: INFO cinder.manager [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Service 2 cleanup completed.
Sep 16 10:58:16 devstack cinder-volume[75768]: DEBUG cinder.service [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Creating RPC server for service cinder-volume {{(pid=75768) start /opt/stack/cinder/cinder/service.py:239}}
Sep 16 10:58:16 devstack cinder-volume[75768]: DEBUG cinder.service [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75768) start /opt/stack/cinder/cinder/service.py:245}}
Sep 16 10:58:16 devstack cinder-volume[75768]: INFO cinder.volume.manager [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 16 10:58:16 devstack cinder-volume[75768]: DEBUG cinder.volume.drivers.lvm [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Updating volume stats {{(pid=75768) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 16 10:58:16 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:16 devstack cinder-volume[75768]: DEBUG dbcounter [-] [75768] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75768) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 10:58:16 devstack sudo[76934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 10:58:17 devstack sudo[76934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:18 devstack sudo[76934]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:18 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.072s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:18 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:19 devstack sudo[76938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 10:58:19 devstack sudo[76938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:20 devstack sudo[76938]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:20 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.030s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:20 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:21 devstack sudo[76945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 10:58:21 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:23 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:23 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.167s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:23 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:58:23 devstack sudo[76948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 10:58:23 devstack sudo[76948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:58:24 devstack sudo[76948]: pam_unix(sudo:session): session closed for user root
Sep 16 10:58:24 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.698s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:58:25 devstack cinder-volume[75768]: INFO cinder.volume.manager [None req-7b53e8b2-0bc7-455d-995d-7a31804abfdd None None] Driver post RPC initialization completed successfully.
Sep 16 10:58:34 devstack cinder-volume[75768]: DEBUG dbcounter [-] [75768] Writing DB stats cinder:SELECT=4 {{(pid=75768) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 10:58:35 devstack cinder-volume[75768]: DEBUG dbcounter [-] [75768] Writing DB stats cinder:UPDATE=1 {{(pid=75768) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 10:59:10 devstack cinder-volume[75768]: DEBUG oslo_service.periodic_task [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75768) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 10:59:10 devstack cinder-volume[75768]: DEBUG cinder.volume.drivers.lvm [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Updating volume stats {{(pid=75768) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 16 10:59:10 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:59:10 devstack sudo[77938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 10:59:10 devstack sudo[77938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:59:11 devstack sudo[77938]: pam_unix(sudo:session): session closed for user root
Sep 16 10:59:12 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.916s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:59:12 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:59:12 devstack sudo[77941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 10:59:12 devstack sudo[77941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:59:13 devstack sudo[77941]: pam_unix(sudo:session): session closed for user root
Sep 16 10:59:13 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.880s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:59:13 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:59:14 devstack sudo[77944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 10:59:14 devstack sudo[77944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:59:15 devstack sudo[77944]: pam_unix(sudo:session): session closed for user root
Sep 16 10:59:15 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.826s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:59:15 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 10:59:15 devstack sudo[77975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 10:59:15 devstack sudo[77975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 10:59:17 devstack sudo[77975]: pam_unix(sudo:session): session closed for user root
Sep 16 10:59:17 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.088s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 10:59:17 devstack cinder-volume[75768]: DEBUG cinder.manager [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Notifying Schedulers of capabilities ... {{(pid=75768) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:00:10 devstack cinder-volume[75768]: DEBUG oslo_service.periodic_task [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75768) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:00:10 devstack cinder-volume[75768]: DEBUG cinder.volume.drivers.lvm [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Updating volume stats {{(pid=75768) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 16 11:00:10 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:00:10 devstack sudo[78711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 11:00:10 devstack sudo[78711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:00:12 devstack sudo[78711]: pam_unix(sudo:session): session closed for user root
Sep 16 11:00:12 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.980s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:00:12 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:00:12 devstack sudo[78714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 11:00:12 devstack sudo[78714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:00:14 devstack sudo[78714]: pam_unix(sudo:session): session closed for user root
Sep 16 11:00:14 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.194s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:00:14 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:00:14 devstack sudo[78745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 11:00:14 devstack sudo[78745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:00:16 devstack sudo[78745]: pam_unix(sudo:session): session closed for user root
Sep 16 11:00:16 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.164s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:00:16 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:00:16 devstack sudo[78749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 11:00:16 devstack sudo[78749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:00:18 devstack sudo[78749]: pam_unix(sudo:session): session closed for user root
Sep 16 11:00:18 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.948s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:00:18 devstack cinder-volume[75768]: DEBUG cinder.manager [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Notifying Schedulers of capabilities ... {{(pid=75768) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:00:35 devstack cinder-volume[75768]: DEBUG dbcounter [-] [75768] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75768) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:01:10 devstack cinder-volume[75768]: DEBUG oslo_service.periodic_task [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75768) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:01:10 devstack cinder-volume[75768]: DEBUG cinder.volume.drivers.lvm [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Updating volume stats {{(pid=75768) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 16 11:01:10 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:01:10 devstack sudo[81039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 11:01:10 devstack sudo[81039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:01:12 devstack sudo[81039]: pam_unix(sudo:session): session closed for user root
Sep 16 11:01:12 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.010s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:01:12 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:01:12 devstack sudo[81185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 11:01:12 devstack sudo[81185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:01:14 devstack sudo[81185]: pam_unix(sudo:session): session closed for user root
Sep 16 11:01:14 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.215s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:01:14 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:01:14 devstack sudo[81347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 11:01:14 devstack sudo[81347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:01:16 devstack sudo[81347]: pam_unix(sudo:session): session closed for user root
Sep 16 11:01:16 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.246s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:01:16 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:01:16 devstack sudo[81507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 11:01:16 devstack sudo[81507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:01:18 devstack sudo[81507]: pam_unix(sudo:session): session closed for user root
Sep 16 11:01:18 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.996s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:01:18 devstack cinder-volume[75768]: DEBUG cinder.manager [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Notifying Schedulers of capabilities ... {{(pid=75768) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:02:10 devstack cinder-volume[75768]: DEBUG oslo_service.periodic_task [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75768) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:02:10 devstack cinder-volume[75768]: DEBUG cinder.volume.drivers.lvm [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Updating volume stats {{(pid=75768) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 16 11:02:10 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:02:10 devstack sudo[82005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 11:02:10 devstack sudo[82005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:02:11 devstack sudo[82005]: pam_unix(sudo:session): session closed for user root
Sep 16 11:02:11 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.863s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:02:11 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:02:12 devstack sudo[82011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 11:02:12 devstack sudo[82011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:02:13 devstack sudo[82011]: pam_unix(sudo:session): session closed for user root
Sep 16 11:02:13 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.956s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:02:13 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:02:14 devstack sudo[82020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 11:02:14 devstack sudo[82020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:02:15 devstack sudo[82020]: pam_unix(sudo:session): session closed for user root
Sep 16 11:02:16 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.070s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:02:16 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:02:16 devstack sudo[82032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 11:02:16 devstack sudo[82032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:02:18 devstack sudo[82032]: pam_unix(sudo:session): session closed for user root
Sep 16 11:02:18 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.074s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:02:18 devstack cinder-volume[75768]: DEBUG cinder.manager [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Notifying Schedulers of capabilities ... {{(pid=75768) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:02:35 devstack cinder-volume[75768]: DEBUG dbcounter [-] [75768] Writing DB stats cinder:SELECT=1 {{(pid=75768) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:02:35 devstack cinder-volume[75768]: DEBUG dbcounter [-] [75768] Writing DB stats cinder:UPDATE=1 {{(pid=75768) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:03:10 devstack cinder-volume[75768]: DEBUG oslo_service.periodic_task [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75768) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:03:10 devstack cinder-volume[75768]: DEBUG cinder.volume.drivers.lvm [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Updating volume stats {{(pid=75768) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 16 11:03:10 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:03:10 devstack sudo[82220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 16 11:03:10 devstack sudo[82220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:03:11 devstack sudo[82220]: pam_unix(sudo:session): session closed for user root
Sep 16 11:03:11 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.723s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:03:11 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:03:11 devstack sudo[82231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 11:03:11 devstack sudo[82231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:03:13 devstack sudo[82231]: pam_unix(sudo:session): session closed for user root
Sep 16 11:03:13 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.749s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:03:13 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:03:13 devstack sudo[82235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 16 11:03:13 devstack sudo[82235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:03:15 devstack sudo[82235]: pam_unix(sudo:session): session closed for user root
Sep 16 11:03:15 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.998s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:03:15 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:03:15 devstack sudo[82247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 16 11:03:15 devstack sudo[82247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:03:17 devstack sudo[82247]: pam_unix(sudo:session): session closed for user root
Sep 16 11:03:17 devstack cinder-volume[75768]: DEBUG oslo_concurrency.processutils [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.056s {{(pid=75768) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:03:17 devstack cinder-volume[75768]: DEBUG cinder.manager [None req-c84aa777-0bc0-44b3-a3e2-05b64d6d6052 None None] Notifying Schedulers of capabilities ... {{(pid=75768) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:03:54 devstack cinder-volume[75611]: INFO oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Caught SIGTERM, stopping children
Sep 16 11:03:54 devstack cinder-volume[75611]: DEBUG oslo_concurrency.lockutils [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Acquiring lock "singleton_lock" {{(pid=75611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 16 11:03:54 devstack cinder-volume[75611]: DEBUG oslo_concurrency.lockutils [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Acquired lock "singleton_lock" {{(pid=75611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 16 11:03:54 devstack cinder-volume[75611]: DEBUG oslo_concurrency.lockutils [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Releasing lock "singleton_lock" {{(pid=75611) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 16 11:03:54 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Stop services. {{(pid=75611) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 16 11:03:54 devstack cinder-volume[75611]: DEBUG oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Killing children. {{(pid=75611) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 16 11:03:54 devstack cinder-volume[75611]: INFO oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Waiting on 1 children to exit
Sep 16 11:03:56 devstack cinder-volume[75768]: DEBUG oslo_concurrency.lockutils [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Acquiring lock "singleton_lock" {{(pid=75768) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 16 11:03:56 devstack cinder-volume[75768]: DEBUG oslo_concurrency.lockutils [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Acquired lock "singleton_lock" {{(pid=75768) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 16 11:03:56 devstack cinder-volume[75768]: DEBUG oslo_concurrency.lockutils [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Releasing lock "singleton_lock" {{(pid=75768) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 16 11:03:56 devstack cinder-volume[75768]: WARNING amqp [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 11:03:56 devstack cinder-volume[75768]: WARNING amqp [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 16 11:03:56 devstack cinder-volume[75611]: INFO oslo_service.backend._eventlet.service [None req-68fbd99f-0bb6-4c94-bb37-ac9ca338cfad None None] Child 75768 exited with status 0
Sep 16 11:04:15 devstack cinder-volume[83142]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83142) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 16 11:04:15 devstack cinder-volume[83142]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83142) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 16 11:04:15 devstack cinder-volume[83142]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83142) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 16 11:04:18 devstack cinder-volume[83142]: INFO dbcounter [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Registered counter for database cinder
Sep 16 11:04:18 devstack cinder-volume[83142]: DEBUG oslo_db.sqlalchemy.engines [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83142) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG dbcounter [-] [83142] Writer thread running {{(pid=83142) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 16 11:04:19 devstack cinder-volume[83142]: INFO cinder.rpc [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 16 11:04:19 devstack cinder-volume[83142]: INFO cinder.rpc [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_db.sqlalchemy.engines [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83142) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 16 11:04:19 devstack cinder-volume[83142]: INFO cinder.volume.manager [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Determined volume DB was empty at startup.
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG cinder.volume.manager [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83142) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 16 11:04:19 devstack cinder-volume[83142]: INFO cinder.volume.manager [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 16 11:04:19 devstack cinder-volume[83142]: WARNING stevedore.named [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 16 11:04:19 devstack cinder-volume[83142]: WARNING castellan.key_manager [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 11:04:19 devstack cinder-volume[83142]: WARNING cinder.keymgr.conf_key_mgr [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 16 11:04:19 devstack cinder-volume[83142]: INFO cinder.volume.manager [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_db.sqlalchemy.engines [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83142) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 16 11:04:19 devstack cinder-volume[83142]: INFO oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Starting 1 workers
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Started child 83386 {{(pid=83142) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 16 11:04:19 devstack cinder-volume[83386]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.1)
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Full set of CONF: {{(pid=83142) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] ******************************************************************************** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Configuration options gathered from: {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] ================================================================================ {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] allow_availability_zone_fallback = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] allow_compression_on_image_upload = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] allowed_direct_url_schemes     = [] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] api_rate_limit                 = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] auth_strategy                  = keystone {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_availability_zone      = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_host                   = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_name                   = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_stats_polling_interval = 60 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backup_api_class               = cinder.backup.api.API {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backup_name_template           = backup-%s {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backup_use_same_host           = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backup_use_temp_snapshot       = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] chap_password                  = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] chap_username                  =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:19 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cinder_internal_tenant_project_id = c6cf7a37268c444ca804e4c44940928d {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cinder_internal_tenant_user_id = 8aba1a6508ac45e08134601e0e3a9ba5 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cluster                        = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] compression_format             = gzip {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] config_dir                     = [] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] config_source                  = [] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] control_exchange               = openstack {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] debug                          = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] default_availability_zone      = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] default_group_type             = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] default_volume_type            = QuobyteHD {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] driver_client_cert             = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] driver_client_cert_key         = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] driver_data_namespace          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] driver_ssl_cert_path           = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] driver_ssl_cert_verify         = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] driver_use_ssl                 = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] enable_new_services            = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] enable_unsupported_driver      = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] enforce_multipath_for_image_xfer = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] filter_function                = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] glance_api_insecure            = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] glance_api_servers             = ['http://192.168.122.148/image'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] glance_api_ssl_compression     = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] glance_ca_certificates_file    = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] glance_certfile                = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] glance_keyfile                 = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] glance_num_retries             = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] glance_request_timeout         = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] goodness_function              = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] graceful_shutdown_timeout      = 5 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] group_api_class                = cinder.group.api.API {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] host                           = devstack {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] image_compress_on_upload       = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] image_conversion_address_space_limit = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] image_conversion_cpu_limit     = 60 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] image_conversion_disable       = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] image_upload_use_cinder_backend = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] image_upload_use_internal_tenant = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] image_volume_cache_enabled     = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] image_volume_cache_max_count   = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] image_volume_cache_max_size_gb = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] init_host_max_objects_retrieval = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] iscsi_iotype                   = fileio {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] iscsi_target_flags             =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] iscsi_write_cache              = on {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] iser_helper                    = tgtadm {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] iser_ip_address                = 192.168.122.148 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] iser_port                      = 3260 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] log_color                      = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] log_config_append              = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] log_dir                        = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] log_file                       = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] log_options                    = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] log_rotate_interval            = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] log_rotate_interval_type       = days {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] log_rotation_type              = none {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] max_age                        = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] max_logfile_count              = 30 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] max_logfile_size_mb            = 200 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] max_over_subscription_ratio    = 20.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] message_reap_interval          = 86400 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] message_ttl                    = 2592000 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] migration_create_volume_timeout_secs = 300 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] monkey_patch                   = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] monkey_patch_modules           = [] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] my_ip                          = 192.168.122.148 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] no_snapshot_gb_quota           = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] num_iser_scan_tries            = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] num_shell_tries                = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] num_volume_device_scan_tries   = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] nvmeof_conn_info_version       = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] nvmet_ns_id                    = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] nvmet_port_id                  = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] osapi_max_limit                = 1000 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] osapi_volume_ext_list          = [] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] osapi_volume_listen_port       = 8776 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] osapi_volume_use_ssl           = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] osapi_volume_workers           = 2 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] per_volume_size_limit          = -1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] periodic_fuzzy_delay           = 60 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] periodic_interval              = 60 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] public_endpoint                = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] publish_errors                 = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] quota_backup_gigabytes         = 1000 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] quota_backups                  = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] quota_gigabytes                = 1000 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] quota_groups                   = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] quota_snapshots                = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] quota_volumes                  = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] rate_limit_burst               = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] rate_limit_except_level        = CRITICAL {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] rate_limit_interval            = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] reinit_driver_count            = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] replication_device             = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] report_discard_supported       = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] report_interval                = 120 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] reservation_clean_interval     = 86400 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] reservation_expire             = 86400 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] reserved_image_namespaces      = [] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] reserved_percentage            = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] rpc_response_timeout           = 120 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] run_external_periodic_tasks    = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] scst_target_driver             = iscsi {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] scst_target_iqn_name           = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_down_time              = 720 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] shell_completion               = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] snapshot_name_template         = snapshot-%s {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] split_loggers                  = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] state_path                     = /opt/stack/data/cinder {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] storage_availability_zone      = nova {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] storage_protocol               = iSCSI {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] syslog_log_facility            = LOG_USER {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] target_helper                  = lioadm {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] target_ip_address              = 192.168.122.148 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] target_port                    = 3260 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] target_protocol                = iscsi {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] target_secondary_ip_addresses  = [] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] trace_flags                    = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] transport_url                  = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] until_refresh                  = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] use_chap_auth                  = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] use_default_quota_class        = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] use_journal                    = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] use_json                       = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] use_multipath_for_image_xfer   = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] use_stderr                     = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] use_syslog                     = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] verify_glance_signatures       = enabled {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_api_class               = cinder.volume.api.API {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_backend_name            = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_clear                   = zero {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_clear_ionice            = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_clear_size              = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_copy_bps_limit          = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_dd_blocksize            = 1M {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_name_template           = volume-%s {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_service_inithost_offload = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volume_usage_audit_period      = month {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] watch_log_file                 = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] zoning_mode                    = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_concurrency.disable_process_locking = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.admin_password = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.admin_token = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.admin_user  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.auth_protocol = https {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.auth_section = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.auth_type   = password {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.auth_uri    = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.auth_version = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.cache       = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.certfile    = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.identity_uri = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.include_service_catalog = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.insecure    = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.interface   = public {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.keyfile     = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_password =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcache_username =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.region_name = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.service_type = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.backend                  = dogpile.cache.null {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.backend_argument         = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.backend_expiration_time  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.config_prefix            = cache.oslo {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.dead_timeout             = 60.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.debug_cache_backend      = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.enable_retry_client      = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.enable_socket_keepalive  = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.enabled                  = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.enforce_fips_mode        = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.expiration_time          = 600 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.hashclient_retry_attempts = 2 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.memcache_dead_retry      = 300 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.memcache_password        = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.memcache_sasl_enabled    = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.memcache_username        = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.proxies                  = [] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.redis_db                 = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.redis_password           = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.redis_server             = localhost:6379 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.redis_socket_timeout     = 1.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.redis_username           = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.retry_attempts           = 2 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.retry_delay              = 0.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.socket_keepalive_count   = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.socket_keepalive_idle    = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.socket_keepalive_interval = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.tls_allowed_ciphers      = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.tls_cafile               = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.tls_certfile             = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.tls_enabled              = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cache.tls_keyfile              = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] coordination.backend_url       = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.asyncio_connection    = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.asyncio_slave_connection = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.backend               = sqlalchemy {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.connection            = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.connection_debug      = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.connection_parameters =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.connection_recycle_time = 3600 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.connection_trace      = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.db_inc_retry_interval = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.db_max_retries        = 20 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.db_max_retry_interval = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.db_retry_interval     = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.max_overflow          = 50 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.max_pool_size         = 5 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.max_retries           = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.mysql_wsrep_sync_wait = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.pool_timeout          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.retry_interval        = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.slave_connection      = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.sqlite_synchronous    = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] database.use_db_reconnect      = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.connection_string     = messaging:// {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.enabled               = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.es_doc_type           = notification {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.es_scroll_size        = 10000 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.es_scroll_time        = 2m {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.filter_error_trace    = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83386) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.hmac_keys             = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.sentinel_service_name = mymaster {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.socket_timeout        = 0.1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.trace_requests        = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler.trace_sqlalchemy      = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler_jaeger.process_tags   = {} {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler_jaeger.service_name_prefix = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] profiler_otlp.service_name_prefix = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.enforce_new_defaults = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: WARNING oslo_config.cfg [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.enforce_scope      = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.policy_default_rule = default {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] privsep_osbrick.group          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] privsep_osbrick.helper_command = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] privsep_osbrick.user           = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cinder_sys_admin.group         = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cinder_sys_admin.helper_command = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] cinder_sys_admin.user          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_user.auth_section      = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_user.auth_type         = password {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_user.certfile          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_user.collect_timing    = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_user.insecure          = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_user.keyfile           = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_user.send_service_user_token = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_user.split_loggers     = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] service_user.timeout           = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.backend_availability_zone = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.chap_password = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.chap_username =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.driver_client_cert = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.driver_client_cert_key = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.driver_data_namespace = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.driver_use_ssl = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.extra_capabilities = {} {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.filter_function = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.goodness_function = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.iscsi_target_flags =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.iscsi_write_cache = on {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.iser_port     = 3260 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nas_host      =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nas_login     = admin {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nas_mount_options = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nas_password  = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nas_private_key =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nas_share_path =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.num_shell_tries = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.quobyte_volume_url = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.replication_device = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.report_discard_supported = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.reserved_percentage = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.target_helper = tgtadm {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.target_port   = 3260 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.target_protocol = iscsi {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.trace_flags   = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.unique_fqdn_network = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.use_chap_auth = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.volume_backend_name = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.volume_clear  = zero {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.volume_clear_ionice = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.volume_clear_size = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_reports.file_event_handler = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_reports.log_dir           = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.backend_availability_zone = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.backend_host         = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.chap_password        = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.chap_username        = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.driver_client_cert   = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.driver_data_namespace = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.extra_capabilities   = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.filter_function      = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.goodness_function    = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.iscsi_iotype         = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.iser_helper          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.iser_ip_address      = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.iser_port            = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nas_host             = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nas_login            = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nas_mount_options    = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nas_password         = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nas_private_key      = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nas_share_path       = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.num_shell_tries      = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.replication_device   = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.report_discard_supported = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.reserved_percentage  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.scst_target_driver   = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.storage_protocol     = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.target_helper        = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.target_ip_address    = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.target_port          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.target_prefix        = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.target_protocol      = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.trace_flags          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.use_chap_auth        = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.volume_clear         = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.volume_clear_size    = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] QuobyteHD.volumes_dir          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_notifications.driver = [] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_notifications.retry = -1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] key_manager.fixed_key          = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.barbican_api_version  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.barbican_endpoint     = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.barbican_endpoint_type = public {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.barbican_region_name  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.cafile                = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.certfile              = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.collect_timing        = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.insecure              = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.keyfile               = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.number_of_retries     = 60 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.retry_delay           = 1 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.send_service_user_token = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.split_loggers         = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.timeout               = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.verify_ssl            = True {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican.verify_ssl_path       = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican_service_user.auth_section = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican_service_user.auth_type = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican_service_user.cafile   = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican_service_user.certfile = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican_service_user.collect_timing = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican_service_user.insecure = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican_service_user.keyfile  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican_service_user.split_loggers = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] barbican_service_user.timeout  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.approle_role_id          = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.approle_secret_id        = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.kv_mountpoint            = secret {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.kv_path                  = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.kv_version               = 2 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.namespace                = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.root_token_id            = **** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.ssl_ca_crt_file          = None {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.timeout                  = 60.0 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.use_ssl                  = False {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 16 11:04:20 devstack cinder-volume[83142]: DEBUG oslo_service.backend._eventlet.service [None req-7b902da3-f9a1-43d2-a3e1-0ba1dfe95d75 None None] ******************************************************************************** {{(pid=83142) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 16 11:04:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83386) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 16 11:04:20 devstack cinder-volume[83386]: INFO cinder.volume.drivers.quobyte [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 16 11:04:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Running cmd (subprocess): mount.quobyte {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:04:21 devstack quobyte-client[83397]: Reading configuration file: /etc/quobyte/client.cfg
Sep 16 11:04:21 devstack quobyte-client[83397]: Invalid parameters found, error: missing mount point.
Sep 16 11:04:21 devstack quobyte-client[83397]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 16 11:04:21 devstack quobyte-client[83397]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] CMD "mount.quobyte" returned: 1 in 0.404s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:04:21 devstack cinder-volume[83386]: INFO cinder.volume.drivers.quobyte [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Mounting volume: 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd ...
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 -c /etc/quobyte/client-cinder.cfg {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:04:21 devstack quobyte-client[83407]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 16 11:04:21 devstack quobyte-client[83407]: Reading configuration file: /etc/quobyte/client.cfg
Sep 16 11:04:21 devstack quobyte-client[83407]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9' to display the log.
Sep 16 11:04:21 devstack quobyte-client[83411]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 16 11:04:21 devstack quobyte-client[83411]: mount.quobyte 3.25 (4fbbd59204)
Sep 16 11:04:21 devstack quobyte-client[83411]: Client UUID: w5TLtcvC-3518-swDs-xLM2-1uZuUF7UebsV
Sep 16 11:04:21 devstack quobyte-client[83411]: Registry: osci01.corp.quobyte.com:7861
Sep 16 11:04:21 devstack quobyte-client[83411]: Volume: cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:04:21 devstack quobyte-client[83411]: FUSE version: 316
Sep 16 11:04:21 devstack quobyte-client[83411]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 16 11:04:21 devstack quobyte-client[83411]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 16 11:04:21 devstack quobyte-client[83411]: Setting total object cache size to 3352297472 bytes
Sep 16 11:04:21 devstack quobyte-client[83411]: Using FUSE low-level API
Sep 16 11:04:21 devstack quobyte-client[83411]: Caching of uid/gid to user/group name mappings is enabled
Sep 16 11:04:21 devstack quobyte-client[83411]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 16 11:04:21 devstack quobyte-client[83411]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 16 11:04:21 devstack quobyte-client[83411]: HTTP server started on port 55000
Sep 16 11:04:21 devstack quobyte-client[83411]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 16 11:04:21 devstack quobyte-client[83411]: Mount point /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 established
Sep 16 11:04:21 devstack quobyte-client[83411]: TimeSync is running and remote sync every 60 seconds
Sep 16 11:04:21 devstack quobyte-client[83411]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 16 11:04:21 devstack quobyte-client[83411]: Ignored time synchronization message because time source took too long to respond (61 ms)
Sep 16 11:04:21 devstack quobyte-client[83411]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 16 11:04:21 devstack quobyte-client[83411]: Opening volume cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd (e598b538-60f2-42d4-adcd-54ff8f5431d9)
Sep 16 11:04:21 devstack quobyte-client[83411]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 16 11:04:21 devstack quobyte-client[83411]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 16 11:04:21 devstack quobyte-client[83411]: Failed to invalidate inode: 38: Function not implemented
Sep 16 11:04:21 devstack quobyte-client[83411]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 16 11:04:21 devstack quobyte-client[83411]: Automatic minidump upload enabled by global system configuration
Sep 16 11:04:21 devstack quobyte-client[83411]: Announcing HTTP status server address 172.24.4.1
Sep 16 11:04:21 devstack quobyte-client[83411]: Registered as service (uuid w5TLtcvC-3518-swDs-xLM2-1uZuUF7UebsV)
Sep 16 11:04:21 devstack quobyte-client[83411]: Quobyte Client running as pid 83411
Sep 16 11:04:21 devstack quobyte-client[83411]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 16 11:04:21 devstack quobyte-client[83411]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.735s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:04:21 devstack cinder-volume[83386]: INFO cinder.volume.drivers.quobyte [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Mounting volume: 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd succeeded
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.796s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:04:21 devstack quobyte-client[83411]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.072s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:04:21 devstack cinder-volume[83386]: INFO cinder.volume.driver [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Driver hasn't implemented _init_vendor_properties()
Sep 16 11:04:21 devstack cinder-volume[83386]: DEBUG cinder.volume.driver [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144706726074, 'free_capacity_gb': 924.9144706726074, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83386) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:844}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG oslo_db.sqlalchemy.engines [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83386) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writer thread running {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG cinder.db.sqlalchemy.api [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Building query based on filter {{(pid=83386) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83386) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 16 11:04:22 devstack cinder-volume[83386]: INFO cinder.keymgr.migration [None req-46b3010a-0b00-40fa-bd7d-e4c29dd8d5a4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.086s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:04:22 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Driver initialization completed successfully.
Sep 16 11:04:22 devstack cinder-volume[83386]: INFO cinder.manager [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Initiating service 3 cleanup
Sep 16 11:04:22 devstack cinder-volume[83386]: INFO cinder.manager [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Service 3 cleanup completed.
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG cinder.service [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Creating RPC server for service cinder-volume {{(pid=83386) start /opt/stack/cinder/cinder/service.py:239}}
Sep 16 11:04:22 devstack cinder-volume[83386]: DEBUG cinder.service [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83386) start /opt/stack/cinder/cinder/service.py:245}}
Sep 16 11:04:23 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 16 11:04:23 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:04:23 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:04:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:04:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:04:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:04:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:04:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:04:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:04:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.112s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:04:23 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3530e65c-2f3c-4a55-bd43-e90b46ef1a04 None None] Driver post RPC initialization completed successfully.
Sep 16 11:04:24 devstack quobyte-client[83411]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 16 11:04:29 devstack cinder-volume[83142]: DEBUG dbcounter [-] [83142] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83142) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:04:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:04:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:05:21 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:05:21 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:05:21 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Flow 'volume_create_manager' (3f30d925-165e-4111-8eb2-b861d8d41966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:05:21 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae0e8d5-77da-4395-90f9-8788de391c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae0e8d5-77da-4395-90f9-8788de391c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1069889718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190a2457-166b-4299-ba16-f383f0f78951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bc4fcc47ea45b680eb383289da5693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:05:21Z,use_quota=True,user_id='dfe064b7246f4c71a9708a9eb4c0ee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cddb832-3d58-43cf-a789-d1e27c76a329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cddb832-3d58-43cf-a789-d1e27c76a329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d17021-a4bc-4284-acea-a03ed4a52300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d17021-a4bc-4284-acea-a03ed4a52300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190a2457-166b-4299-ba16-f383f0f78951', 'volume_name': 'volume-190a2457-166b-4299-ba16-f383f0f78951', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f0acf6-707b-43b5-95ff-4cdc2ee45b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72f0acf6-707b-43b5-95ff-4cdc2ee45b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4692d459-919a-4a85-9390-5e78e78d9ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:22 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Volume 190a2457-166b-4299-ba16-f383f0f78951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190a2457-166b-4299-ba16-f383f0f78951', 'volume_size': 1}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1069889718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190a2457-166b-4299-ba16-f383f0f78951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bc4fcc47ea45b680eb383289da5693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:05:21Z,use_quota=True,user_id='dfe064b7246f4c71a9708a9eb4c0ee79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Creating volume 190a2457-166b-4299-ba16-f383f0f78951 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:05:22 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:05:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-190a2457-166b-4299-ba16-f383f0f78951 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:22 devstack quobyte-client[83411]: System call of process 83671 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:05:22 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=2, name=volume-190a2457-166b-4299-ba16-f383f0f78951, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-190a2457-166b-4299-ba16-f383f0f78951 1073741824" returned: 0 in 0.985s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-190a2457-166b-4299-ba16-f383f0f78951 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-190a2457-166b-4299-ba16-f383f0f78951" returned: 0 in 0.178s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] <== create_volume: return (1245ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4692d459-919a-4a85-9390-5e78e78d9ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190a2457-166b-4299-ba16-f383f0f78951', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3804c3a7-5a52-4f3a-9d9c-507ba82f951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:23 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Volume volume-190a2457-166b-4299-ba16-f383f0f78951 (190a2457-166b-4299-ba16-f383f0f78951): created successfully
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3804c3a7-5a52-4f3a-9d9c-507ba82f951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Flow 'volume_create_manager' (3f30d925-165e-4111-8eb2-b861d8d41966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:05:23 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Flow 'volume_create_manager' (7fd7837e-bdf2-410c-83a6-559019faf6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024dd27c-1e9f-4d10-a904-7e43bcccc743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (024dd27c-1e9f-4d10-a904-7e43bcccc743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1000715159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f0c877-ca2e-475a-bf28-e1ac97b7ad40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2cd04883bf4e3284d3daf8319c96a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:05:24Z,use_quota=True,user_id='c09f5219769e4154870cd4a60a83daeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb3d673-2d87-40e8-9dcc-adbf14c5f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb3d673-2d87-40e8-9dcc-adbf14c5f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f528765c-5c8e-4da1-9798-51fa1b43121d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-aa33ef88-2740-4bb6-b77a-5fbe5e8df768 tempest-TaggedAttachmentsTest-974391377 None] Created volume successfully.
Sep 16 11:05:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:05:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:05:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:05:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.279s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:24 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:05:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f528765c-5c8e-4da1-9798-51fa1b43121d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '20f0c877-ca2e-475a-bf28-e1ac97b7ad40', 'volume_name': 'volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff89d7f4670>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3b26dd-e880-429a-b532-a6848afc8a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3b26dd-e880-429a-b532-a6848afc8a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc971f2-7daa-4683-b1a3-efbff174ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:25 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Volume 20f0c877-ca2e-475a-bf28-e1ac97b7ad40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff89d7f4670>}
Sep 16 11:05:25 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Cloning 20f0c877-ca2e-475a-bf28-e1ac97b7ad40 from image ae172bdc-0a7f-403f-a999-85b28d841ddd  at location (None, None). {{(pid=83386) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 16 11:05:27 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD, size 20.69 MB, duration 2.38 sec {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 16 11:05:27 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Image download 20.69 MB at 8.70 MB/s
Sep 16 11:05:27 devstack cinder-volume[83386]: INFO oslo.privsep.daemon [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkzox265u/privsep.sock']
Sep 16 11:05:27 devstack sudo[84012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkzox265u/privsep.sock
Sep 16 11:05:27 devstack sudo[84012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:05:30 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Flow 'volume_create_manager' (6ecc9d11-fa71-4e11-a3c1-d5b7fe619618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8a6940-b34a-4455-b60e-86cf8ca7a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8a6940-b34a-4455-b60e-86cf8ca7a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1288837643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f735f2bc-182f-4ff7-a61f-2a1f5eff658c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e55aa12b6f24053ae5d95a0f897d7d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:05:30Z,use_quota=True,user_id='2b5ad6fc421f4c608e207167f976a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbe234f-f35c-4a31-8e06-54fee58f4df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbe234f-f35c-4a31-8e06-54fee58f4df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0170a7d2-23dc-4edc-9cc0-812c1cc98165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0170a7d2-23dc-4edc-9cc0-812c1cc98165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f735f2bc-182f-4ff7-a61f-2a1f5eff658c', 'volume_name': 'volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b669f58-fdcc-43b9-8b51-f458d27c37a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b669f58-fdcc-43b9-8b51-f458d27c37a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d6f9ea-d249-4d72-af27-3cad1b1a8017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:30 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Volume f735f2bc-182f-4ff7-a61f-2a1f5eff658c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c', 'volume_size': 1}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1288837643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f735f2bc-182f-4ff7-a61f-2a1f5eff658c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e55aa12b6f24053ae5d95a0f897d7d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:05:30Z,use_quota=True,user_id='2b5ad6fc421f4c608e207167f976a4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Creating volume f735f2bc-182f-4ff7-a61f-2a1f5eff658c {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:05:30 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:05:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:31 devstack quobyte-client[83411]: System call of process 84016 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:05:31 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=3, name=volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:05:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c 1073741824" returned: 0 in 0.662s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c" returned: 0 in 0.406s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] <== create_volume: return (1145ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:05:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d6f9ea-d249-4d72-af27-3cad1b1a8017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44c2c7f-3c04-4688-b13b-62fd9ffd6f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:32 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Volume volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c (f735f2bc-182f-4ff7-a61f-2a1f5eff658c): created successfully
Sep 16 11:05:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d44c2c7f-3c04-4688-b13b-62fd9ffd6f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Flow 'volume_create_manager' (6ecc9d11-fa71-4e11-a3c1-d5b7fe619618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:05:32 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ec61cc2a-e901-4bd7-a95f-0fa4005a09a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Created volume successfully.
Sep 16 11:05:33 devstack sudo[84012]: pam_unix(sudo:session): session closed for user root
Sep 16 11:05:33 devstack cinder-volume[83386]: INFO oslo.privsep.daemon [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Spawned new privsep daemon via rootwrap
Sep 16 11:05:33 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Accepted privsep connection to /tmp/tmpkzox265u/privsep.sock {{(pid=83386) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 16 11:05:33 devstack cinder-volume[83386]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 16 11:05:33 devstack cinder-volume[83386]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 16 11:05:33 devstack cinder-volume[83386]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 16 11:05:33 devstack cinder-volume[83386]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84015
Sep 16 11:05:33 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73b8900-6ce3-467f-a76d-0f0968afb4c4]: (2,) {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:05:33 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb707361-124a-45aa-b897-6299e4cc4b50]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:05:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:33 devstack sudo[84024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD
Sep 16 11:05:33 devstack sudo[84024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:05:35 devstack sudo[84024]: pam_unix(sudo:session): session closed for user root
Sep 16 11:05:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD" returned: 0 in 2.430s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:35 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Temporary image ae172bdc-0a7f-403f-a999-85b28d841ddd is fetched for user c09f5219769e4154870cd4a60a83daeb. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 16 11:05:36 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da757f5-96a1-4040-865b-d4c4c3ba1f67]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:05:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:36 devstack sudo[84031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD
Sep 16 11:05:36 devstack sudo[84031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:05:38 devstack sudo[84031]: pam_unix(sudo:session): session closed for user root
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD" returned: 0 in 2.578s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1000715159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20f0c877-ca2e-475a-bf28-e1ac97b7ad40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2cd04883bf4e3284d3daf8319c96a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:05:24Z,use_quota=True,user_id='c09f5219769e4154870cd4a60a83daeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Creating volume 20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:05:38 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:05:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:38 devstack quobyte-client[83411]: System call of process 84041 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:05:38 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=4, name=volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:05:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 1073741824" returned: 0 in 0.427s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" returned: 0 in 0.071s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] <== create_volume: return (574ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:05:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.612s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:39 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Attempting download of ae172bdc-0a7f-403f-a999-85b28d841ddd ((None, None)) to volume 20f0c877-ca2e-475a-bf28-e1ac97b7ad40. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 16 11:05:39 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7d9404-c79a-4d1e-9104-4015dc719a85]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:05:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_q1a5q49_ {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_q1a5q49_" returned: 0 in 0.519s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_q1a5q49_ {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_q1a5q49_" returned: 1 in 0.464s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_q1a5q49_' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:05:40 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb53295-8367-487a-b9e3-9d4ce2243d0c]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:05:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:41 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] ae172bdc-0a7f-403f-a999-85b28d841ddd was qcow2, converting to raw {{(pid=83386) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 16 11:05:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:41 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=4, name=volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:05:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" returned: 0 in 1.682s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:43 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_va4lk45cdevstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:05:43 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Converted 112.00 MB image at 65.29 MB/s
Sep 16 11:05:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 1G" returned: 0 in 0.326s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:43 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba66bd-15a6-4210-8cc2-b878d6e88142]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:05:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" returned: 0 in 0.899s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" returned: 1 in 1.030s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:05:45 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Downloaded image ae172bdc-0a7f-403f-a999-85b28d841ddd ((None, None)) to volume 20f0c877-ca2e-475a-bf28-e1ac97b7ad40 successfully. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 16 11:05:45 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Temporary image ae172bdc-0a7f-403f-a999-85b28d841ddd for user c09f5219769e4154870cd4a60a83daeb is deleted. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 16 11:05:45 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Marking volume 20f0c877-ca2e-475a-bf28-e1ac97b7ad40 as bootable. {{(pid=83386) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 16 11:05:45 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Copying metadata from image ae172bdc-0a7f-403f-a999-85b28d841ddd to 20f0c877-ca2e-475a-bf28-e1ac97b7ad40. {{(pid=83386) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 11:05:45 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Creating volume glance metadata for volume 20f0c877-ca2e-475a-bf28-e1ac97b7ad40 backed by image ae172bdc-0a7f-403f-a999-85b28d841ddd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83386) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 11:05:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc971f2-7daa-4683-b1a3-efbff174ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff89d7f4670>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df71b74-c030-4a51-89ac-91d6f9bae158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:46 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Volume volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 (20f0c877-ca2e-475a-bf28-e1ac97b7ad40): created successfully
Sep 16 11:05:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df71b74-c030-4a51-89ac-91d6f9bae158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Flow 'volume_create_manager' (7fd7837e-bdf2-410c-83a6-559019faf6ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:05:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-0fdedf3c-49ff-4506-b3ce-de2587881ed0 tempest-TaggedBootDevicesTest-1938459507 None] Created volume successfully.
Sep 16 11:05:48 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Flow 'volume_create_manager' (384fd1b0-c6d6-42f8-bea9-b92555980792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3789403a-0df3-4e50-80f6-bd6d24433991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3789403a-0df3-4e50-80f6-bd6d24433991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1316423057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a655cf-70bf-4059-8401-746c434710c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2cd04883bf4e3284d3daf8319c96a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:05:48Z,use_quota=True,user_id='c09f5219769e4154870cd4a60a83daeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd2493b-71a2-4c7c-ac4c-6b71a338bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd2493b-71a2-4c7c-ac4c-6b71a338bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ba18ef-b3b3-4a84-828f-35dba0924eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34ba18ef-b3b3-4a84-828f-35dba0924eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a655cf-70bf-4059-8401-746c434710c9', 'volume_name': 'volume-78a655cf-70bf-4059-8401-746c434710c9', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44451cb7-35bd-4ddb-bad9-53d3310612d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44451cb7-35bd-4ddb-bad9-53d3310612d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab43697-c715-4942-bf51-732fce0bedcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:48 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Volume 78a655cf-70bf-4059-8401-746c434710c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a655cf-70bf-4059-8401-746c434710c9', 'volume_size': 1}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1316423057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a655cf-70bf-4059-8401-746c434710c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2cd04883bf4e3284d3daf8319c96a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:05:48Z,use_quota=True,user_id='c09f5219769e4154870cd4a60a83daeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Creating volume 78a655cf-70bf-4059-8401-746c434710c9 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:05:48 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:05:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-78a655cf-70bf-4059-8401-746c434710c9 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:48 devstack quobyte-client[83411]: System call of process 84094 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:05:48 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=5, name=volume-78a655cf-70bf-4059-8401-746c434710c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:05:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-78a655cf-70bf-4059-8401-746c434710c9 1073741824" returned: 0 in 0.476s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-78a655cf-70bf-4059-8401-746c434710c9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-78a655cf-70bf-4059-8401-746c434710c9" returned: 0 in 0.211s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] <== create_volume: return (823ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:05:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab43697-c715-4942-bf51-732fce0bedcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a655cf-70bf-4059-8401-746c434710c9', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce30acd-3110-4faf-84c5-76e029b7e8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:49 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Volume volume-78a655cf-70bf-4059-8401-746c434710c9 (78a655cf-70bf-4059-8401-746c434710c9): created successfully
Sep 16 11:05:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce30acd-3110-4faf-84c5-76e029b7e8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Flow 'volume_create_manager' (384fd1b0-c6d6-42f8-bea9-b92555980792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:05:49 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f626c8ec-8475-4a10-aeb3-c214b8673ded tempest-TaggedBootDevicesTest-1938459507 None] Created volume successfully.
Sep 16 11:05:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Flow 'volume_create_manager' (0a71330d-cae5-41b9-a96a-ed73e70fdc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35f7ad0-555a-4779-b3da-ed4c641cd647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35f7ad0-555a-4779-b3da-ed4c641cd647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-810084905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2cd04883bf4e3284d3daf8319c96a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:05:51Z,use_quota=True,user_id='c09f5219769e4154870cd4a60a83daeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4c778d-3e59-4031-b642-70612efb0d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4c778d-3e59-4031-b642-70612efb0d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522b5bc6-ab2e-4df4-b0d9-3efbb1459840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (522b5bc6-ab2e-4df4-b0d9-3efbb1459840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1', 'volume_name': 'volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d67b0e0-90b4-4cb1-8edd-0b296c3d1b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d67b0e0-90b4-4cb1-8edd-0b296c3d1b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c668cc1b-8506-470a-bcea-3681bd2b8905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:51 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Volume 6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1', 'volume_size': 1}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-810084905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2cd04883bf4e3284d3daf8319c96a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:05:51Z,use_quota=True,user_id='c09f5219769e4154870cd4a60a83daeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Creating volume 6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:05:51 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:51 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=6, name=volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1 1073741824" returned: 0 in 0.352s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:05:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1" returned: 0 in 0.201s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:05:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] <== create_volume: return (689ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:05:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:05:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c668cc1b-8506-470a-bcea-3681bd2b8905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4408bca9-05aa-4982-97be-43e472442cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:05:52 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Volume volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1 (6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1): created successfully
Sep 16 11:05:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4408bca9-05aa-4982-97be-43e472442cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:05:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Flow 'volume_create_manager' (0a71330d-cae5-41b9-a96a-ed73e70fdc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:05:52 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-a1dda009-1b74-4dde-a0b8-1bde8d3ac5f6 tempest-TaggedBootDevicesTest-1938459507 None] Created volume successfully.
Sep 16 11:06:02 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:DELETE=3,cinder:INSERT=9 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:06:02 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=11,cinder:SELECT=14,cinder:INSERT=4,cinder:DELETE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:06:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:06:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:06:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:06:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:06:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:06:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:06:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:06:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.440s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:06:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:06:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:06:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:06:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:06:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.074s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:06:57 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[68526448-4ec4-44ca-8464-31bf7abfb65c]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:06:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:06:58 devstack quobyte-client[83411]: System call of process 84423 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:06:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" returned: 0 in 1.011s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:06:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:06:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" returned: 1 in 1.591s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:06:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:06:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.960s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:07:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cec9d085-7243-4428-9b51-9e1f4210ae8a', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:07:00 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:07:01 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-344b484f-b0ba-47df-8cfa-22e52df9f930 tempest-TaggedBootDevicesTest-1938459507 None] attachment_update completed successfully.
Sep 16 11:07:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-1f8b1386-2ae2-4fa8-b3a7-b092d719a46d tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:07:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-1f8b1386-2ae2-4fa8-b3a7-b092d719a46d tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:07:05 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2c14bb-5fb0-4df3-b32f-59ff17953340]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:07:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-1f8b1386-2ae2-4fa8-b3a7-b092d719a46d tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-78a655cf-70bf-4059-8401-746c434710c9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:07:07 devstack quobyte-client[83411]: System call of process 84516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:07:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-1f8b1386-2ae2-4fa8-b3a7-b092d719a46d tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-78a655cf-70bf-4059-8401-746c434710c9" returned: 0 in 2.310s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:07:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-1f8b1386-2ae2-4fa8-b3a7-b092d719a46d tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.459s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:07:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-1f8b1386-2ae2-4fa8-b3a7-b092d719a46d tempest-TaggedBootDevicesTest-1938459507 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-78a655cf-70bf-4059-8401-746c434710c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49e8b5aa-cf14-4c38-bc33-538b31727fc3', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:07:08 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-1f8b1386-2ae2-4fa8-b3a7-b092d719a46d tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:07:08 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-1f8b1386-2ae2-4fa8-b3a7-b092d719a46d tempest-TaggedBootDevicesTest-1938459507 None] attachment_update completed successfully.
Sep 16 11:07:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-f721c6c9-8e88-4e85-b4cc-4f82dbd85343 tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:07:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-f721c6c9-8e88-4e85-b4cc-4f82dbd85343 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:07:12 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f001b5-d303-425f-9f0a-f631ddb56957]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:07:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-f721c6c9-8e88-4e85-b4cc-4f82dbd85343 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:07:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-f721c6c9-8e88-4e85-b4cc-4f82dbd85343 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1" returned: 0 in 0.578s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:07:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-f721c6c9-8e88-4e85-b4cc-4f82dbd85343 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.686s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:07:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-f721c6c9-8e88-4e85-b4cc-4f82dbd85343 tempest-TaggedBootDevicesTest-1938459507 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ffc97d2-4266-4db9-bb1b-8419679e3d8b', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:07:13 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-f721c6c9-8e88-4e85-b4cc-4f82dbd85343 tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:07:13 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-de0e2504-201d-4a14-b001-c52a8b0b59dc req-f721c6c9-8e88-4e85-b4cc-4f82dbd85343 tempest-TaggedBootDevicesTest-1938459507 None] attachment_update completed successfully.
Sep 16 11:07:23 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=20,cinder:UPDATE=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:07:23 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=13,cinder:UPDATE=6 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:07:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:07:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:07:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:07:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:07:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:07:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:07:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:07:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.087s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:07:24 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:07:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-1858086c-2174-4110-be22-08847a326272 req-d2def2a4-e221-4aa7-b007-edd1936818d5 tempest-VolumesAssistedSnapshotsTest-433091232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:07:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-1858086c-2174-4110-be22-08847a326272 req-d2def2a4-e221-4aa7-b007-edd1936818d5 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:07:49 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10a087f-71f4-4866-b1da-079cf94e4265]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:07:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-1858086c-2174-4110-be22-08847a326272 req-d2def2a4-e221-4aa7-b007-edd1936818d5 tempest-VolumesAssistedSnapshotsTest-433091232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:07:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-1858086c-2174-4110-be22-08847a326272 req-d2def2a4-e221-4aa7-b007-edd1936818d5 tempest-VolumesAssistedSnapshotsTest-433091232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c" returned: 0 in 1.385s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:07:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-1858086c-2174-4110-be22-08847a326272 req-d2def2a4-e221-4aa7-b007-edd1936818d5 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.497s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:07:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-1858086c-2174-4110-be22-08847a326272 req-d2def2a4-e221-4aa7-b007-edd1936818d5 tempest-VolumesAssistedSnapshotsTest-433091232 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a2c4c06-7a42-4e6f-94d5-42217e4c06bc', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:07:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-1858086c-2174-4110-be22-08847a326272 req-d2def2a4-e221-4aa7-b007-edd1936818d5 tempest-VolumesAssistedSnapshotsTest-433091232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:07:51 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-1858086c-2174-4110-be22-08847a326272 req-d2def2a4-e221-4aa7-b007-edd1936818d5 tempest-VolumesAssistedSnapshotsTest-433091232 None] attachment_update completed successfully.
Sep 16 11:08:01 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:08:01 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:08:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-840742bc-0e25-4156-8d31-dc67d128d5b8 req-8b771f0b-9b70-44e6-aba2-0e6686786c85 tempest-TaggedAttachmentsTest-974391377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:08:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-840742bc-0e25-4156-8d31-dc67d128d5b8 req-8b771f0b-9b70-44e6-aba2-0e6686786c85 tempest-TaggedAttachmentsTest-974391377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:08:14 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb34718e-22ef-44bc-95be-6982f35921e5]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:08:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-840742bc-0e25-4156-8d31-dc67d128d5b8 req-8b771f0b-9b70-44e6-aba2-0e6686786c85 tempest-TaggedAttachmentsTest-974391377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-190a2457-166b-4299-ba16-f383f0f78951 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:08:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-840742bc-0e25-4156-8d31-dc67d128d5b8 req-8b771f0b-9b70-44e6-aba2-0e6686786c85 tempest-TaggedAttachmentsTest-974391377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-190a2457-166b-4299-ba16-f383f0f78951" returned: 0 in 0.562s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:08:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-840742bc-0e25-4156-8d31-dc67d128d5b8 req-8b771f0b-9b70-44e6-aba2-0e6686786c85 tempest-TaggedAttachmentsTest-974391377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.640s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:08:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-840742bc-0e25-4156-8d31-dc67d128d5b8 req-8b771f0b-9b70-44e6-aba2-0e6686786c85 tempest-TaggedAttachmentsTest-974391377 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-190a2457-166b-4299-ba16-f383f0f78951', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '659d9e17-4305-4a43-a881-6cc005e18c73', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:08:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-840742bc-0e25-4156-8d31-dc67d128d5b8 req-8b771f0b-9b70-44e6-aba2-0e6686786c85 tempest-TaggedAttachmentsTest-974391377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:08:15 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-840742bc-0e25-4156-8d31-dc67d128d5b8 req-8b771f0b-9b70-44e6-aba2-0e6686786c85 tempest-TaggedAttachmentsTest-974391377 None] attachment_update completed successfully.
Sep 16 11:08:22 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-8e102ddc-3a87-457f-8b61-6db6e8e7f49c req-03d0a184-67d0-4fe7-ae27-5c3f017054a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:08:22 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-8e102ddc-3a87-457f-8b61-6db6e8e7f49c req-03d0a184-67d0-4fe7-ae27-5c3f017054a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:08:22 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-8e102ddc-3a87-457f-8b61-6db6e8e7f49c req-03d0a184-67d0-4fe7-ae27-5c3f017054a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Terminate volume connection completed successfully.
Sep 16 11:08:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-8e102ddc-3a87-457f-8b61-6db6e8e7f49c req-03d0a184-67d0-4fe7-ae27-5c3f017054a0 tempest-VolumesAssistedSnapshotsTest-433091232 None] Deleting attachment 5a2c4c06-7a42-4e6f-94d5-42217e4c06bc. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:08:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:08:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:08:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:08:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:08:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:08:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:08:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:08:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Acquiring lock "cinder-f735f2bc-182f-4ff7-a61f-2a1f5eff658c-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:08:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.669s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:08:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "cinder-f735f2bc-182f-4ff7-a61f-2a1f5eff658c-delete_volume" acquired by "delete_volume" :: waited 0.286s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:08:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:08:25 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:08:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Acquiring lock "cinder-quobyte-f735f2bc-182f-4ff7-a61f-2a1f5eff658c" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:08:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "cinder-quobyte-f735f2bc-182f-4ff7-a61f-2a1f5eff658c" acquired by "delete_volume" :: waited 0.017s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:08:25 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b96a54-0faf-446c-8b91-a1fb4cdc877d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:08:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:08:26 devstack quobyte-client[83411]: System call of process 85654 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:08:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c" returned: 0 in 0.683s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:08:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:08:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f735f2bc-182f-4ff7-a61f-2a1f5eff658c" returned: 0 in 0.132s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:08:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "cinder-quobyte-f735f2bc-182f-4ff7-a61f-2a1f5eff658c" released by "delete_volume" :: held 1.014s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:08:26 devstack cinder-volume[83386]: WARNING cinder.quota [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:08:26 devstack cinder-volume[83386]: WARNING cinder.quota [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:08:27 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Created reservations ['59b4f121-225f-4f10-80a0-27b2ca5bc20b', '014d128e-ee47-45c0-a5b0-f8b1d82efc41', 'dfdd9056-3ca1-4aae-afd7-1cbd31135532', '9eca4850-5566-424d-bb5c-7305b6c9de50'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:08:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:08:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:08:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:08:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:08:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:08:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:08:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.189s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:08:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:08:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Deleted volume successfully.
Sep 16 11:08:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e4ca6b99-96d3-4953-a31f-f014d9545469 tempest-VolumesAssistedSnapshotsTest-433091232 None] Lock "cinder-f735f2bc-182f-4ff7-a61f-2a1f5eff658c-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:08:37 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=11,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:08:37 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:08:46 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-011b3bfc-1ef9-4e41-97d8-55b5582de343 req-1fd87914-de15-41aa-9aed-3edc7f3566e4 tempest-TaggedAttachmentsTest-974391377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:08:46 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-011b3bfc-1ef9-4e41-97d8-55b5582de343 req-1fd87914-de15-41aa-9aed-3edc7f3566e4 tempest-TaggedAttachmentsTest-974391377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:08:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-011b3bfc-1ef9-4e41-97d8-55b5582de343 req-1fd87914-de15-41aa-9aed-3edc7f3566e4 tempest-TaggedAttachmentsTest-974391377 None] Terminate volume connection completed successfully.
Sep 16 11:08:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-011b3bfc-1ef9-4e41-97d8-55b5582de343 req-1fd87914-de15-41aa-9aed-3edc7f3566e4 tempest-TaggedAttachmentsTest-974391377 None] Deleting attachment 659d9e17-4305-4a43-a881-6cc005e18c73. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:08:56 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:08:56 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:09:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:09:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:09:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:09:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:09:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:09:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.151s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:09:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:09:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.414s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:09:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:09:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Acquiring lock "cinder-190a2457-166b-4299-ba16-f383f0f78951-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:09:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Lock "cinder-190a2457-166b-4299-ba16-f383f0f78951-delete_volume" acquired by "delete_volume" :: waited 0.150s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:09:36 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:09:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Acquiring lock "cinder-quobyte-190a2457-166b-4299-ba16-f383f0f78951" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:09:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Lock "cinder-quobyte-190a2457-166b-4299-ba16-f383f0f78951" acquired by "delete_volume" :: waited 0.053s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:09:36 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[36252c6e-7dd4-41ca-95a8-79ce55583a75]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:09:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-190a2457-166b-4299-ba16-f383f0f78951 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:09:37 devstack quobyte-client[83411]: System call of process 85888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:09:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-190a2457-166b-4299-ba16-f383f0f78951" returned: 0 in 0.623s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:09:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-190a2457-166b-4299-ba16-f383f0f78951 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:09:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-190a2457-166b-4299-ba16-f383f0f78951" returned: 0 in 0.130s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:09:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Lock "cinder-quobyte-190a2457-166b-4299-ba16-f383f0f78951" released by "delete_volume" :: held 0.989s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:09:38 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Created reservations ['17d2aa61-7457-498f-85c0-57c7e1be79c6', '6f6a03ca-1a33-4b73-807e-9ab5315e66e0', 'f8dad255-ad99-4cda-86ae-44507b6cdb9d', '170309c9-98d2-4eae-bd98-37f9955df9f4'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:09:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:09:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:09:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:09:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:09:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:09:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:09:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.148s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:09:38 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:09:38 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Deleted volume successfully.
Sep 16 11:09:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a505658b-ef38-41d0-8d32-eaf0171b67c8 tempest-TaggedAttachmentsTest-974391377 None] Lock "cinder-190a2457-166b-4299-ba16-f383f0f78951-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:09:48 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=5,cinder:UPDATE=13 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:09:48 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:10:09 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-024971e4-9568-4080-832d-503d14f1db44 tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:10:09 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-024971e4-9568-4080-832d-503d14f1db44 tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:10:09 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-024971e4-9568-4080-832d-503d14f1db44 tempest-TaggedBootDevicesTest-1938459507 None] Terminate volume connection completed successfully.
Sep 16 11:10:09 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-024971e4-9568-4080-832d-503d14f1db44 tempest-TaggedBootDevicesTest-1938459507 None] Deleting attachment cec9d085-7243-4428-9b51-9e1f4210ae8a. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:10:10 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-177779d6-973d-4607-8dd0-092a128dc7bd tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:10:10 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-177779d6-973d-4607-8dd0-092a128dc7bd tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:10:10 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-177779d6-973d-4607-8dd0-092a128dc7bd tempest-TaggedBootDevicesTest-1938459507 None] Terminate volume connection completed successfully.
Sep 16 11:10:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-177779d6-973d-4607-8dd0-092a128dc7bd tempest-TaggedBootDevicesTest-1938459507 None] Deleting attachment 49e8b5aa-cf14-4c38-bc33-538b31727fc3. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:10:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-0df6e61c-f41e-4bc8-96e4-96e0fb47d98c tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:10:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-0df6e61c-f41e-4bc8-96e4-96e0fb47d98c tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:10:11 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-0df6e61c-f41e-4bc8-96e4-96e0fb47d98c tempest-TaggedBootDevicesTest-1938459507 None] Terminate volume connection completed successfully.
Sep 16 11:10:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-b76114fe-3bf4-4a2a-b70d-740e516a9be7 req-0df6e61c-f41e-4bc8-96e4-96e0fb47d98c tempest-TaggedBootDevicesTest-1938459507 None] Deleting attachment 4ffc97d2-4266-4db9-bb1b-8419679e3d8b. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:10:21 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:10:21 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:10:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:10:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:10:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:10:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:10:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:10:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:10:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.184s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:24 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:10:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "cinder-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:10:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:10:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:10:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "cinder-quobyte-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:10:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-quobyte-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1" acquired by "delete_volume" :: waited 0.029s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:10:27 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[973047d9-6e9b-4703-9be2-eb72be42b659]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:10:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1" returned: 0 in 0.686s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1" returned: 0 in 0.096s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-quobyte-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1" released by "delete_volume" :: held 1.066s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Created reservations ['52d7f5f9-474a-46ca-9fcf-7cf3cedad061', '22779473-8f4c-41bf-a50a-dd5929483741', '9e28ac00-a145-46f2-b5a5-23e8cd5fd6c9', '5bb40050-d9a4-4914-ba2a-073c21f80f61'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.109s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:10:29 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Deleted volume successfully.
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5c7b263f-ab72-400e-965d-0b1cdcad05ac tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-6fd5e7ad-11c1-44f1-b6b5-bf6f6280c9a1-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "cinder-78a655cf-70bf-4059-8401-746c434710c9-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:10:29 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-78a655cf-70bf-4059-8401-746c434710c9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:10:30 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:10:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "cinder-quobyte-78a655cf-70bf-4059-8401-746c434710c9" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:10:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-quobyte-78a655cf-70bf-4059-8401-746c434710c9" acquired by "delete_volume" :: waited 0.020s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:10:30 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1479480-8841-4d2f-9fb7-666c47108f32]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:10:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-78a655cf-70bf-4059-8401-746c434710c9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-78a655cf-70bf-4059-8401-746c434710c9" returned: 0 in 0.506s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-78a655cf-70bf-4059-8401-746c434710c9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-78a655cf-70bf-4059-8401-746c434710c9" returned: 0 in 0.128s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-quobyte-78a655cf-70bf-4059-8401-746c434710c9" released by "delete_volume" :: held 0.789s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:10:31 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Created reservations ['2b889f62-afe0-49d5-b0da-1daa00df32e9', '8fa7428e-c2fd-4167-8359-c848892fb451', '0f707c2e-5b0e-47f4-a5eb-9359baf7790d', 'f9d8f03e-cfbb-493c-b925-63bfec77ab77'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:10:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:10:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:10:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:10:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:10:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:10:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.131s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:31 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:10:31 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Deleted volume successfully.
Sep 16 11:10:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-06a7aee6-d04f-4813-bc67-b1ff13988f4d tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-78a655cf-70bf-4059-8401-746c434710c9-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:10:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "cinder-20f0c877-ca2e-475a-bf28-e1ac97b7ad40-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:10:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-20f0c877-ca2e-475a-bf28-e1ac97b7ad40-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:10:32 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:10:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "cinder-quobyte-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:10:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-quobyte-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" acquired by "delete_volume" :: waited 0.021s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:10:32 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[150c1a26-448c-463a-9a44-d1470ecf9308]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:10:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" returned: 0 in 0.557s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" returned: 1 in 0.551s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:10:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" returned: 0 in 0.139s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-quobyte-20f0c877-ca2e-475a-bf28-e1ac97b7ad40" released by "delete_volume" :: held 1.665s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:10:35 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Created reservations ['c602f745-b236-45aa-bceb-51d166c771dd', 'e939350c-41d7-4a7d-bbff-28521387d0c4', 'bc1cc1f4-c476-486b-8139-e71b8d478899', '9589f15e-67a6-4c9f-8dc7-1a91f5a7d114'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:10:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:10:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:10:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:10:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:10:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.170s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:10:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:10:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.520s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:10:36 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:10:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Deleted volume successfully.
Sep 16 11:10:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8914f231-4042-45f5-b8b0-162e3dc440f6 tempest-TaggedBootDevicesTest-1938459507 None] Lock "cinder-20f0c877-ca2e-475a-bf28-e1ac97b7ad40-delete_volume" released by "delete_volume" :: held 4.807s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:10:45 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=25,cinder:SELECT=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:10:47 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=17,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:11:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:11:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:11:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:11:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:11:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:11:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:11:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:11:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.292s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:11:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:11:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:11:51 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Flow 'volume_create_manager' (8656994a-0a66-49e9-bd13-cbe1a89ce21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef35144-e8c5-4c3f-a214-5bf1b89d9d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef35144-e8c5-4c3f-a214-5bf1b89d9d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1355357990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501b68da-7ff5-4af7-962f-509873ad34ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab595d292b84d1981f5bf779500b1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:11:52Z,use_quota=True,user_id='800ce30828c94cd182b4c7b8decb1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcad7a29-6ec6-483b-b5a2-74055283e099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcad7a29-6ec6-483b-b5a2-74055283e099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef570240-58dc-4d77-821a-fc28829f99cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef570240-58dc-4d77-821a-fc28829f99cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '501b68da-7ff5-4af7-962f-509873ad34ac', 'volume_name': 'volume-501b68da-7ff5-4af7-962f-509873ad34ac', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f99c5cd-23eb-4fe2-993f-460ac045ec9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f99c5cd-23eb-4fe2-993f-460ac045ec9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42885e46-9cb8-4380-b5e0-ee090457a120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:11:52 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Volume 501b68da-7ff5-4af7-962f-509873ad34ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-501b68da-7ff5-4af7-962f-509873ad34ac', 'volume_size': 1}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1355357990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=501b68da-7ff5-4af7-962f-509873ad34ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab595d292b84d1981f5bf779500b1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:11:52Z,use_quota=True,user_id='800ce30828c94cd182b4c7b8decb1ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Creating volume 501b68da-7ff5-4af7-962f-509873ad34ac {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:11:52 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:11:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-501b68da-7ff5-4af7-962f-509873ad34ac 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:11:52 devstack quobyte-client[83411]: System call of process 86715 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:11:52 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=7, name=volume-501b68da-7ff5-4af7-962f-509873ad34ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:11:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-501b68da-7ff5-4af7-962f-509873ad34ac 1073741824" returned: 0 in 0.964s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:11:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-501b68da-7ff5-4af7-962f-509873ad34ac {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:11:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-501b68da-7ff5-4af7-962f-509873ad34ac" returned: 0 in 0.342s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:11:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] <== create_volume: return (1443ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:11:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:11:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42885e46-9cb8-4380-b5e0-ee090457a120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-501b68da-7ff5-4af7-962f-509873ad34ac', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:11:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1315865-cfcd-494e-a4b2-80bac18907c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:11:54 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Volume volume-501b68da-7ff5-4af7-962f-509873ad34ac (501b68da-7ff5-4af7-962f-509873ad34ac): created successfully
Sep 16 11:11:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1315865-cfcd-494e-a4b2-80bac18907c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:11:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Flow 'volume_create_manager' (8656994a-0a66-49e9-bd13-cbe1a89ce21d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:11:54 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-1bc0af9a-b1e8-4ed1-ba30-792b0aac819c tempest-AttachSCSIVolumeTestJSON-1602469730 None] Created volume successfully.
Sep 16 11:12:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-0d90e4ff-a7aa-4ae3-ace4-908ec3a46087 req-1b3346b0-6daf-4c3a-9478-b3ead8ea44a8 tempest-AttachSCSIVolumeTestJSON-1602469730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:12:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-0d90e4ff-a7aa-4ae3-ace4-908ec3a46087 req-1b3346b0-6daf-4c3a-9478-b3ead8ea44a8 tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:12:01 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[374b4111-b786-46e0-91f5-5ef403a53b5a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:12:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-0d90e4ff-a7aa-4ae3-ace4-908ec3a46087 req-1b3346b0-6daf-4c3a-9478-b3ead8ea44a8 tempest-AttachSCSIVolumeTestJSON-1602469730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-501b68da-7ff5-4af7-962f-509873ad34ac {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:12:02 devstack quobyte-client[83411]: System call of process 86802 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:12:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-0d90e4ff-a7aa-4ae3-ace4-908ec3a46087 req-1b3346b0-6daf-4c3a-9478-b3ead8ea44a8 tempest-AttachSCSIVolumeTestJSON-1602469730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-501b68da-7ff5-4af7-962f-509873ad34ac" returned: 0 in 0.667s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:12:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-0d90e4ff-a7aa-4ae3-ace4-908ec3a46087 req-1b3346b0-6daf-4c3a-9478-b3ead8ea44a8 tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.803s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:12:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-0d90e4ff-a7aa-4ae3-ace4-908ec3a46087 req-1b3346b0-6daf-4c3a-9478-b3ead8ea44a8 tempest-AttachSCSIVolumeTestJSON-1602469730 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-501b68da-7ff5-4af7-962f-509873ad34ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d035e33-e700-4d39-8e76-1f0f2bad7435', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:12:02 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-0d90e4ff-a7aa-4ae3-ace4-908ec3a46087 req-1b3346b0-6daf-4c3a-9478-b3ead8ea44a8 tempest-AttachSCSIVolumeTestJSON-1602469730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:12:03 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-0d90e4ff-a7aa-4ae3-ace4-908ec3a46087 req-1b3346b0-6daf-4c3a-9478-b3ead8ea44a8 tempest-AttachSCSIVolumeTestJSON-1602469730 None] attachment_update completed successfully.
Sep 16 11:12:13 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:12:13 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:12:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Flow 'volume_create_manager' (402c5c89-e0d8-4e64-899f-bc8b73026cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932f26bd-0eb4-4d8e-886c-6623d5c882ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932f26bd-0eb4-4d8e-886c-6623d5c882ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-329210484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a428ed6b-03b9-4a1b-bd1e-7e10b641a705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10333bf66e604aeb8d48587946fc3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:12:24Z,use_quota=True,user_id='06692531120b4c4bbf70c9b5e65e7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5983133-233e-400a-ae7f-da665feae040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5983133-233e-400a-ae7f-da665feae040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00a0683-5d32-471a-91a0-2516fe7d269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00a0683-5d32-471a-91a0-2516fe7d269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a428ed6b-03b9-4a1b-bd1e-7e10b641a705', 'volume_name': 'volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8136efd-b87f-402f-aff4-30c2eb177384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8136efd-b87f-402f-aff4-30c2eb177384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61bdda0-ac81-4af6-ae9b-c32b4e524509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:12:24 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume a428ed6b-03b9-4a1b-bd1e-7e10b641a705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705', 'volume_size': 1}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-329210484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a428ed6b-03b9-4a1b-bd1e-7e10b641a705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10333bf66e604aeb8d48587946fc3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:12:24Z,use_quota=True,user_id='06692531120b4c4bbf70c9b5e65e7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Creating volume a428ed6b-03b9-4a1b-bd1e-7e10b641a705 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:12:24 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:12:24 devstack quobyte-client[83411]: System call of process 87312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:12:24 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=8, name=volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:12:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.271s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:12:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:12:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705 1073741824" returned: 0 in 0.990s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:12:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:12:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705" returned: 0 in 0.158s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:12:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] <== create_volume: return (1239ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:12:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:12:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61bdda0-ac81-4af6-ae9b-c32b4e524509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:12:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64987791-c318-4960-a174-24e59bb71f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:12:25 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705 (a428ed6b-03b9-4a1b-bd1e-7e10b641a705): created successfully
Sep 16 11:12:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64987791-c318-4960-a174-24e59bb71f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:12:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Flow 'volume_create_manager' (402c5c89-e0d8-4e64-899f-bc8b73026cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:12:25 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ed3c6789-16c8-4863-ac5f-89f577895198 tempest-AttachVolumeShelveTestJSON-1697274340 None] Created volume successfully.
Sep 16 11:12:34 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-01c938a5-c1a3-4ab4-a8bd-1fd2e29889be req-0816fb81-1fef-4b36-ac05-c4ca3f84ef2d tempest-AttachSCSIVolumeTestJSON-1602469730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:12:34 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-01c938a5-c1a3-4ab4-a8bd-1fd2e29889be req-0816fb81-1fef-4b36-ac05-c4ca3f84ef2d tempest-AttachSCSIVolumeTestJSON-1602469730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:12:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-01c938a5-c1a3-4ab4-a8bd-1fd2e29889be req-0816fb81-1fef-4b36-ac05-c4ca3f84ef2d tempest-AttachSCSIVolumeTestJSON-1602469730 None] Terminate volume connection completed successfully.
Sep 16 11:12:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-01c938a5-c1a3-4ab4-a8bd-1fd2e29889be req-0816fb81-1fef-4b36-ac05-c4ca3f84ef2d tempest-AttachSCSIVolumeTestJSON-1602469730 None] Deleting attachment 1d035e33-e700-4d39-8e76-1f0f2bad7435. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:12:35 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:12:44 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:12:51 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Acquiring lock "cinder-501b68da-7ff5-4af7-962f-509873ad34ac-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:12:51 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "cinder-501b68da-7ff5-4af7-962f-509873ad34ac-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:12:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:12:51 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Acquiring lock "cinder-quobyte-501b68da-7ff5-4af7-962f-509873ad34ac" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:12:51 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "cinder-quobyte-501b68da-7ff5-4af7-962f-509873ad34ac" acquired by "delete_volume" :: waited 0.015s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:12:51 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bf5589-03f0-43ee-92ca-11ee15b4ea1b]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:12:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-501b68da-7ff5-4af7-962f-509873ad34ac {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-501b68da-7ff5-4af7-962f-509873ad34ac" returned: 0 in 0.521s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-501b68da-7ff5-4af7-962f-509873ad34ac {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-501b68da-7ff5-4af7-962f-509873ad34ac" returned: 0 in 0.092s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "cinder-quobyte-501b68da-7ff5-4af7-962f-509873ad34ac" released by "delete_volume" :: held 0.806s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Created reservations ['7752087c-8b20-43a0-8b0c-4913a734cfd3', 'bb32ba22-db8f-42d4-9d6c-0b5e89e98e97', '7bcce5f6-222b-47bc-a1b2-8c68918736f5', '254a465e-1890-4915-8e64-2ef6e44a74f0'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:12:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:12:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.115s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:12:53 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:12:53 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Deleted volume successfully.
Sep 16 11:12:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a3f4834d-a0eb-4b96-8fbe-22240f07b0df tempest-AttachSCSIVolumeTestJSON-1602469730 None] Lock "cinder-501b68da-7ff5-4af7-962f-509873ad34ac-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:12:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-2b443158-df81-4ca4-b498-53d1a192e419 req-721dbf53-4bec-4990-957e-1634eff747ab tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:12:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-2b443158-df81-4ca4-b498-53d1a192e419 req-721dbf53-4bec-4990-957e-1634eff747ab tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:12:58 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b21222-5e60-4f96-87b6-761cfdaaca63]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:12:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-2b443158-df81-4ca4-b498-53d1a192e419 req-721dbf53-4bec-4990-957e-1634eff747ab tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:12:59 devstack quobyte-client[83411]: System call of process 87541 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:12:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-2b443158-df81-4ca4-b498-53d1a192e419 req-721dbf53-4bec-4990-957e-1634eff747ab tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705" returned: 0 in 0.761s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:12:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-2b443158-df81-4ca4-b498-53d1a192e419 req-721dbf53-4bec-4990-957e-1634eff747ab tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:12:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-2b443158-df81-4ca4-b498-53d1a192e419 req-721dbf53-4bec-4990-957e-1634eff747ab tempest-AttachVolumeShelveTestJSON-1697274340 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f213756f-e3f5-4114-89ef-3bbc5d474d58', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:12:59 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-2b443158-df81-4ca4-b498-53d1a192e419 req-721dbf53-4bec-4990-957e-1634eff747ab tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:12:59 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-2b443158-df81-4ca4-b498-53d1a192e419 req-721dbf53-4bec-4990-957e-1634eff747ab tempest-AttachVolumeShelveTestJSON-1697274340 None] attachment_update completed successfully.
Sep 16 11:13:09 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:13:09 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=14,cinder:SELECT=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:13:13 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:13:13 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:13:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Flow 'volume_create_manager' (5637810c-2d8e-4838-8232-f853da409cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:13:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8a812e-84d9-4094-82b6-dcdb95f9615d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8a812e-84d9-4094-82b6-dcdb95f9615d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-943576559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab289b4-6387-4684-a9c1-87e1781ebc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aec70fab6fb4b9ca06ea75896833147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:13:13Z,use_quota=True,user_id='910c89a52d2945e8a37c3d07db988604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f0480e-e5c1-40e4-b1b9-70d6c494b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f0480e-e5c1-40e4-b1b9-70d6c494b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb2f571-a82a-43f7-8cea-f225f3dbe4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb2f571-a82a-43f7-8cea-f225f3dbe4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab289b4-6387-4684-a9c1-87e1781ebc11', 'volume_name': 'volume-1ab289b4-6387-4684-a9c1-87e1781ebc11', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ebfaa8-4cb1-441b-8f50-75277895d9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ebfaa8-4cb1-441b-8f50-75277895d9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72412c8-9ddd-4c94-a196-eda269be2f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:13:14 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Volume 1ab289b4-6387-4684-a9c1-87e1781ebc11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab289b4-6387-4684-a9c1-87e1781ebc11', 'volume_size': 1}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-943576559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab289b4-6387-4684-a9c1-87e1781ebc11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aec70fab6fb4b9ca06ea75896833147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:13:13Z,use_quota=True,user_id='910c89a52d2945e8a37c3d07db988604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Creating volume 1ab289b4-6387-4684-a9c1-87e1781ebc11 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:13:14 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:13:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ab289b4-6387-4684-a9c1-87e1781ebc11 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:13:14 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=9, name=volume-1ab289b4-6387-4684-a9c1-87e1781ebc11, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:13:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ab289b4-6387-4684-a9c1-87e1781ebc11 1073741824" returned: 0 in 0.847s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:13:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ab289b4-6387-4684-a9c1-87e1781ebc11 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:13:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ab289b4-6387-4684-a9c1-87e1781ebc11" returned: 0 in 0.786s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:13:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] <== create_volume: return (2019ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:13:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:13:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72412c8-9ddd-4c94-a196-eda269be2f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab289b4-6387-4684-a9c1-87e1781ebc11', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:13:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d1324c-d6bc-47a0-a41f-4492eb99eb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:13:17 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Volume volume-1ab289b4-6387-4684-a9c1-87e1781ebc11 (1ab289b4-6387-4684-a9c1-87e1781ebc11): created successfully
Sep 16 11:13:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d1324c-d6bc-47a0-a41f-4492eb99eb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:13:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Flow 'volume_create_manager' (5637810c-2d8e-4838-8232-f853da409cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:13:17 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-10605cb6-2822-472c-9e5f-0613603c352a tempest-AttachVolumeNegativeTest-986806239 None] Created volume successfully.
Sep 16 11:13:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6d4f8955-8c5d-4161-8cc5-66a4c99faced req-5b89b7e8-fd83-40cb-b30b-829d5fc786b6 tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:13:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6d4f8955-8c5d-4161-8cc5-66a4c99faced req-5b89b7e8-fd83-40cb-b30b-829d5fc786b6 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:13:23 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02802f5-6f94-4dd3-a349-80ece870f041]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:13:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-6d4f8955-8c5d-4161-8cc5-66a4c99faced req-5b89b7e8-fd83-40cb-b30b-829d5fc786b6 tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ab289b4-6387-4684-a9c1-87e1781ebc11 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:13:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-6d4f8955-8c5d-4161-8cc5-66a4c99faced req-5b89b7e8-fd83-40cb-b30b-829d5fc786b6 tempest-AttachVolumeNegativeTest-986806239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ab289b4-6387-4684-a9c1-87e1781ebc11" returned: 0 in 0.704s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:13:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6d4f8955-8c5d-4161-8cc5-66a4c99faced req-5b89b7e8-fd83-40cb-b30b-829d5fc786b6 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:13:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6d4f8955-8c5d-4161-8cc5-66a4c99faced req-5b89b7e8-fd83-40cb-b30b-829d5fc786b6 tempest-AttachVolumeNegativeTest-986806239 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-1ab289b4-6387-4684-a9c1-87e1781ebc11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3eacf37b-faf1-4354-a1d5-da297824d988', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:13:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-6d4f8955-8c5d-4161-8cc5-66a4c99faced req-5b89b7e8-fd83-40cb-b30b-829d5fc786b6 tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:13:25 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-6d4f8955-8c5d-4161-8cc5-66a4c99faced req-5b89b7e8-fd83-40cb-b30b-829d5fc786b6 tempest-AttachVolumeNegativeTest-986806239 None] attachment_update completed successfully.
Sep 16 11:13:35 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:13:35 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:14:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:14:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:14:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:14:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:14:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:14:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:14:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:14:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.210s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:14:24 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:14:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:14:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:14:52 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:14:52 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:14:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Flow 'volume_create_manager' (f5591f86-af40-4468-8b07-3c5959e4125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8c87dc-a45b-4cd5-bce7-ea10599c88ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8c87dc-a45b-4cd5-bce7-ea10599c88ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-385633272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95993c8e-51e8-4081-ae83-3e2f7fcecdb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2595ec57f45743198714b48badaf941b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:14:53Z,use_quota=True,user_id='03d70ee15d434d8ea2800a873a4164f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e31b51-4310-4506-9a17-6216d6e80696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e31b51-4310-4506-9a17-6216d6e80696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2770ffe4-593b-4f53-8240-fbcbc2d3b359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2770ffe4-593b-4f53-8240-fbcbc2d3b359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95993c8e-51e8-4081-ae83-3e2f7fcecdb8', 'volume_name': 'volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3566a7-5556-42fe-bf75-107a39a900ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3566a7-5556-42fe-bf75-107a39a900ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c86562-c679-4167-910a-37f60df4c052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:14:53 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Volume 95993c8e-51e8-4081-ae83-3e2f7fcecdb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8', 'volume_size': 1}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-385633272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95993c8e-51e8-4081-ae83-3e2f7fcecdb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2595ec57f45743198714b48badaf941b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:14:53Z,use_quota=True,user_id='03d70ee15d434d8ea2800a873a4164f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Creating volume 95993c8e-51e8-4081-ae83-3e2f7fcecdb8 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:14:53 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:14:53 devstack quobyte-client[83411]: System call of process 88461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:14:53 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=10, name=volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8 1073741824" returned: 0 in 0.663s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:14:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8" returned: 0 in 0.111s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:14:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] <== create_volume: return (866ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:14:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:14:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c86562-c679-4167-910a-37f60df4c052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:14:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8415ee-7aac-4092-b66c-94c9b0fee979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:14:54 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Volume volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8 (95993c8e-51e8-4081-ae83-3e2f7fcecdb8): created successfully
Sep 16 11:14:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8415ee-7aac-4092-b66c-94c9b0fee979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:14:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Flow 'volume_create_manager' (f5591f86-af40-4468-8b07-3c5959e4125f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:14:54 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-a271e80c-5651-4e34-8057-d4c1c8e77830 tempest-VolumesAdminNegativeTest-1046437707 None] Created volume successfully.
Sep 16 11:14:55 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Acquiring lock "cinder-95993c8e-51e8-4081-ae83-3e2f7fcecdb8-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:14:55 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Lock "cinder-95993c8e-51e8-4081-ae83-3e2f7fcecdb8-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:14:56 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:14:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Acquiring lock "cinder-quobyte-95993c8e-51e8-4081-ae83-3e2f7fcecdb8" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:14:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Lock "cinder-quobyte-95993c8e-51e8-4081-ae83-3e2f7fcecdb8" acquired by "delete_volume" :: waited 0.021s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:14:56 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21b4484-3aca-4869-ad3a-5c56c486698a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:14:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:14:56 devstack quobyte-client[83411]: System call of process 88468 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:14:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8" returned: 0 in 0.699s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:14:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-95993c8e-51e8-4081-ae83-3e2f7fcecdb8" returned: 0 in 0.270s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Lock "cinder-quobyte-95993c8e-51e8-4081-ae83-3e2f7fcecdb8" released by "delete_volume" :: held 1.157s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Created reservations ['c5d8afae-7682-4f24-8e5f-b21bb35b7c13', 'dfca8f45-210d-4fcd-99f6-8fb8549a050a', '5aaaf6f7-f3b7-4c11-b852-1081d34aefcb', '9788c85d-04ec-4301-9c8c-06eb80935729'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.111s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:14:57 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:14:57 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Deleted volume successfully.
Sep 16 11:14:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2b7adaf4-d066-445a-8b36-bbb560d55f09 tempest-VolumesAdminNegativeTest-1046437707 None] Lock "cinder-95993c8e-51e8-4081-ae83-3e2f7fcecdb8-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:15:07 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=9,cinder:DELETE=1,cinder:UPDATE=12 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:15:08 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=8,cinder:SELECT=3,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:15:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-48468b98-6879-497b-9883-a22898107067 req-dc459325-2484-442a-957c-36d2cfa893b1 tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:15:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-48468b98-6879-497b-9883-a22898107067 req-dc459325-2484-442a-957c-36d2cfa893b1 tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:15:18 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-48468b98-6879-497b-9883-a22898107067 req-dc459325-2484-442a-957c-36d2cfa893b1 tempest-AttachVolumeShelveTestJSON-1697274340 None] Terminate volume connection completed successfully.
Sep 16 11:15:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-48468b98-6879-497b-9883-a22898107067 req-dc459325-2484-442a-957c-36d2cfa893b1 tempest-AttachVolumeShelveTestJSON-1697274340 None] Deleting attachment f213756f-e3f5-4114-89ef-3bbc5d474d58. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:15:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:15:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:15:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:15:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:15:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:15:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:15:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:15:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.404s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:15:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:15:28 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:16:02 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-fee468a3-07a9-4797-ad1e-aefd38d6cf97 req-ebacaf0c-9374-471e-bf3f-5bf3af4ed3f4 tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:16:03 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-fee468a3-07a9-4797-ad1e-aefd38d6cf97 req-ebacaf0c-9374-471e-bf3f-5bf3af4ed3f4 tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:16:03 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-fee468a3-07a9-4797-ad1e-aefd38d6cf97 req-ebacaf0c-9374-471e-bf3f-5bf3af4ed3f4 tempest-AttachVolumeNegativeTest-986806239 None] Terminate volume connection completed successfully.
Sep 16 11:16:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-fee468a3-07a9-4797-ad1e-aefd38d6cf97 req-ebacaf0c-9374-471e-bf3f-5bf3af4ed3f4 tempest-AttachVolumeNegativeTest-986806239 None] Deleting attachment 3eacf37b-faf1-4354-a1d5-da297824d988. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:16:12 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:16:13 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:16:20 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Flow 'volume_create_manager' (0b8ddb28-7030-43ea-9cd9-70274981bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6442c8-1d31-4000-b14b-5f6c5a864cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6442c8-1d31-4000-b14b-5f6c5a864cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-320440838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e8c2ffc68545279d2438e42d81ee3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:16:20Z,use_quota=True,user_id='159b8a2146924047a9ed100b5624c0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c9e40d-eff9-4722-b879-357c33fa3189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c9e40d-eff9-4722-b879-357c33fa3189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2539b2-f7f1-4c51-9c6e-2bb9f1433b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b2539b2-f7f1-4c51-9c6e-2bb9f1433b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90', 'volume_name': 'volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93dc5b8-eeba-46dc-a90e-c94fe7cb4860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c93dc5b8-eeba-46dc-a90e-c94fe7cb4860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57c0e55-7e6f-48e8-bdb4-9d1f590a077c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:16:20 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Volume a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90', 'volume_size': 1}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-320440838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22e8c2ffc68545279d2438e42d81ee3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:16:20Z,use_quota=True,user_id='159b8a2146924047a9ed100b5624c0dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Creating volume a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:16:20 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:16:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:16:21 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=11, name=volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:16:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90 1073741824" returned: 0 in 0.584s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:16:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:16:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90" returned: 0 in 0.285s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:16:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] <== create_volume: return (1043ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:16:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:16:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57c0e55-7e6f-48e8-bdb4-9d1f590a077c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:16:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e93520-b54d-41c8-a113-e1da429f1be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:16:22 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Volume volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90 (a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90): created successfully
Sep 16 11:16:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e93520-b54d-41c8-a113-e1da429f1be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:16:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Flow 'volume_create_manager' (0b8ddb28-7030-43ea-9cd9-70274981bf85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:16:22 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d56932c5-3e19-4e00-b4e3-2570d2587bb3 tempest-DeleteServersTestJSON-1014987150 None] Created volume successfully.
Sep 16 11:16:24 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:16:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:16:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:16:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:16:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:16:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:16:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:16:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.111s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:16:24 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:16:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-b3607516-0696-4787-a23d-b7ce17217738 req-48a0ee6f-9eae-4212-9b09-82ad9f158238 tempest-DeleteServersTestJSON-1014987150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:16:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-b3607516-0696-4787-a23d-b7ce17217738 req-48a0ee6f-9eae-4212-9b09-82ad9f158238 tempest-DeleteServersTestJSON-1014987150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:16:30 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72891ef-738d-4885-9624-5b453b4a46ef]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:16:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-b3607516-0696-4787-a23d-b7ce17217738 req-48a0ee6f-9eae-4212-9b09-82ad9f158238 tempest-DeleteServersTestJSON-1014987150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:16:31 devstack quobyte-client[83411]: System call of process 88991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:16:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-b3607516-0696-4787-a23d-b7ce17217738 req-48a0ee6f-9eae-4212-9b09-82ad9f158238 tempest-DeleteServersTestJSON-1014987150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90" returned: 0 in 1.255s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:16:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-b3607516-0696-4787-a23d-b7ce17217738 req-48a0ee6f-9eae-4212-9b09-82ad9f158238 tempest-DeleteServersTestJSON-1014987150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.515s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:16:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-b3607516-0696-4787-a23d-b7ce17217738 req-48a0ee6f-9eae-4212-9b09-82ad9f158238 tempest-DeleteServersTestJSON-1014987150 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bd1aed9-ffae-42e1-bdb1-47ebb028e59d', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:16:32 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b3607516-0696-4787-a23d-b7ce17217738 req-48a0ee6f-9eae-4212-9b09-82ad9f158238 tempest-DeleteServersTestJSON-1014987150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:16:33 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-b3607516-0696-4787-a23d-b7ce17217738 req-48a0ee6f-9eae-4212-9b09-82ad9f158238 tempest-DeleteServersTestJSON-1014987150 None] attachment_update completed successfully.
Sep 16 11:16:43 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:16:43 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=8 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:16:50 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-e7768aa9-b6ed-4ee7-a882-de1acdf27ed7 req-8ae29cd0-fbb6-44be-8b72-6abb5ff31086 tempest-DeleteServersTestJSON-1014987150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:16:50 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-e7768aa9-b6ed-4ee7-a882-de1acdf27ed7 req-8ae29cd0-fbb6-44be-8b72-6abb5ff31086 tempest-DeleteServersTestJSON-1014987150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:16:50 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-e7768aa9-b6ed-4ee7-a882-de1acdf27ed7 req-8ae29cd0-fbb6-44be-8b72-6abb5ff31086 tempest-DeleteServersTestJSON-1014987150 None] Terminate volume connection completed successfully.
Sep 16 11:16:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-e7768aa9-b6ed-4ee7-a882-de1acdf27ed7 req-8ae29cd0-fbb6-44be-8b72-6abb5ff31086 tempest-DeleteServersTestJSON-1014987150 None] Deleting attachment 7bd1aed9-ffae-42e1-bdb1-47ebb028e59d. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:16:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Acquiring lock "cinder-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:16:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Lock "cinder-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:16:56 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:16:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Acquiring lock "cinder-quobyte-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:16:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Lock "cinder-quobyte-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90" acquired by "delete_volume" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:16:56 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a117d9f5-ef70-4872-8d35-e908299b0893]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:16:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90" returned: 0 in 0.530s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90" returned: 0 in 0.077s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Lock "cinder-quobyte-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90" released by "delete_volume" :: held 0.764s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Created reservations ['8d96e6ec-8ce0-4399-8407-ab0f47ab8ff5', 'c629b4c7-ce93-48cd-9783-305be1b54f88', '1acc7463-068e-4b4e-8d0e-d62b5377e0cd', '50d703fa-03dd-4c90-8402-b2d17bd4392a'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:16:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:16:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.131s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:16:58 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:16:58 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Deleted volume successfully.
Sep 16 11:16:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99bccb07-dfe0-4a8b-9118-f17806bb0156 tempest-DeleteServersTestJSON-1014987150 None] Lock "cinder-a01d545b-8df5-4b3a-b9d5-2d4ffb7baa90-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:17:07 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=12 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:17:08 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:17:23 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Flow 'volume_create_manager' (bc545b15-aff5-4c2c-9b41-943c643933f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6533ac-e36c-4aac-8319-16dc007333cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6533ac-e36c-4aac-8319-16dc007333cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1958810899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10333bf66e604aeb8d48587946fc3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:17:23Z,use_quota=True,user_id='06692531120b4c4bbf70c9b5e65e7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150f0ef3-37a9-4662-a681-a3cc5f029c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150f0ef3-37a9-4662-a681-a3cc5f029c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac90ba48-0eb6-4c05-aeed-df45fb726db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac90ba48-0eb6-4c05-aeed-df45fb726db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0', 'volume_name': 'volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c30c123-5705-4b4f-90d1-729c7282f9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c30c123-5705-4b4f-90d1-729c7282f9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56b59af-f6fc-417b-be7f-09286d2aba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:17:23 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume 7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0', 'volume_size': 1}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1958810899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10333bf66e604aeb8d48587946fc3f0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:17:23Z,use_quota=True,user_id='06692531120b4c4bbf70c9b5e65e7af8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Creating volume 7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.082s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:17:23 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:17:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:17:24 devstack quobyte-client[83411]: System call of process 89648 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:17:24 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=12, name=volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:17:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:17:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:17:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.176s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:17:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:17:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:17:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.150s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:17:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:17:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0 1073741824" returned: 0 in 2.917s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:17:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:17:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.894s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:17:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:17:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0" returned: 0 in 0.543s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:17:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] <== create_volume: return (3706ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:17:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.726s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:17:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56b59af-f6fc-417b-be7f-09286d2aba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:17:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf9c06e-dd9d-473d-a126-925e977a7472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:17:28 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0 (7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0): created successfully
Sep 16 11:17:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf9c06e-dd9d-473d-a126-925e977a7472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:17:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Flow 'volume_create_manager' (bc545b15-aff5-4c2c-9b41-943c643933f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:17:28 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ecfcd6fe-fb3b-4425-a303-c3703b3fdd6f tempest-AttachVolumeShelveTestJSON-1697274340 None] Created volume successfully.
Sep 16 11:17:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:17:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:17:57 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-f43aa374-0d88-41c3-91ff-1c6cbac8fd29 req-be711eff-1e83-4af8-ad64-ac9d31879f64 tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:17:57 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-f43aa374-0d88-41c3-91ff-1c6cbac8fd29 req-be711eff-1e83-4af8-ad64-ac9d31879f64 tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:17:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-f43aa374-0d88-41c3-91ff-1c6cbac8fd29 req-be711eff-1e83-4af8-ad64-ac9d31879f64 tempest-AttachVolumeShelveTestJSON-1697274340 None] No connector for attachment f6f77126-bdba-493e-909e-4cd5d57d60cc; skipping storage backend terminate_connection call. {{(pid=83386) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 16 11:17:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-f43aa374-0d88-41c3-91ff-1c6cbac8fd29 req-be711eff-1e83-4af8-ad64-ac9d31879f64 tempest-AttachVolumeShelveTestJSON-1697274340 None] Deleting attachment f6f77126-bdba-493e-909e-4cd5d57d60cc. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:18:07 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:18:07 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:18:21 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:18:21 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:18:21 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Flow 'volume_create_manager' (2a5c3835-994e-431b-afb5-dd44fbfa5c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:18:21 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de30c80e-c57d-4dfc-b067-ab77291eef44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de30c80e-c57d-4dfc-b067-ab77291eef44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1861126235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aec70fab6fb4b9ca06ea75896833147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:18:21Z,use_quota=True,user_id='910c89a52d2945e8a37c3d07db988604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7eedd44-29b2-4788-926b-3918a78b5450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7eedd44-29b2-4788-926b-3918a78b5450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72be06a-2778-4a1c-818b-56ca764d1068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72be06a-2778-4a1c-818b-56ca764d1068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a', 'volume_name': 'volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69ad0b0-212c-44a8-a37a-db31c4e9ed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69ad0b0-212c-44a8-a37a-db31c4e9ed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee246c8-d7df-43cf-821d-dd8e5e20f336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:18:22 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Volume a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a', 'volume_size': 1}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1861126235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aec70fab6fb4b9ca06ea75896833147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:18:21Z,use_quota=True,user_id='910c89a52d2945e8a37c3d07db988604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Creating volume a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:18:22 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:18:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:18:22 devstack quobyte-client[83411]: System call of process 89936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:18:23 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=13, name=volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:18:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a 1073741824" returned: 0 in 2.230s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:18:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:18:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:18:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:18:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:18:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:18:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:18:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.076s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:18:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:18:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a" returned: 0 in 2.008s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:18:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] <== create_volume: return (5004ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:18:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.084s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:18:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee246c8-d7df-43cf-821d-dd8e5e20f336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:18:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c12a8a-3d6c-4b0c-b5ca-b9ca267f2f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:18:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 3.189s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:18:28 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:18:29 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Volume volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a (a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a): created successfully
Sep 16 11:18:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c12a8a-3d6c-4b0c-b5ca-b9ca267f2f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:18:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Flow 'volume_create_manager' (2a5c3835-994e-431b-afb5-dd44fbfa5c15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:18:29 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-58a98b02-6522-4c2d-a238-47148fe493d4 tempest-AttachVolumeNegativeTest-986806239 None] Created volume successfully.
Sep 16 11:18:39 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:18:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-9f1d93c2-6fd4-46c6-95aa-de12255ef4b0 req-aaca6c5e-abcf-47b2-b416-7d6da70c58fc tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:18:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-9f1d93c2-6fd4-46c6-95aa-de12255ef4b0 req-aaca6c5e-abcf-47b2-b416-7d6da70c58fc tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:18:39 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6298d9-cc54-428a-a25b-b5e45e283030]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:18:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-9f1d93c2-6fd4-46c6-95aa-de12255ef4b0 req-aaca6c5e-abcf-47b2-b416-7d6da70c58fc tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:18:40 devstack quobyte-client[83411]: System call of process 90021 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:18:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-9f1d93c2-6fd4-46c6-95aa-de12255ef4b0 req-aaca6c5e-abcf-47b2-b416-7d6da70c58fc tempest-AttachVolumeNegativeTest-986806239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a" returned: 0 in 1.656s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:18:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-9f1d93c2-6fd4-46c6-95aa-de12255ef4b0 req-aaca6c5e-abcf-47b2-b416-7d6da70c58fc tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.834s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:18:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-9f1d93c2-6fd4-46c6-95aa-de12255ef4b0 req-aaca6c5e-abcf-47b2-b416-7d6da70c58fc tempest-AttachVolumeNegativeTest-986806239 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bb18c0a-0cea-42f0-8289-13dbb871b66a', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:18:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-9f1d93c2-6fd4-46c6-95aa-de12255ef4b0 req-aaca6c5e-abcf-47b2-b416-7d6da70c58fc tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:18:42 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-9f1d93c2-6fd4-46c6-95aa-de12255ef4b0 req-aaca6c5e-abcf-47b2-b416-7d6da70c58fc tempest-AttachVolumeNegativeTest-986806239 None] attachment_update completed successfully.
Sep 16 11:18:52 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=6 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:18:52 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:19:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Flow 'volume_create_manager' (76a8b98d-123f-4d05-8528-96609b44ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dcc86c-01d7-4927-af3b-ec50432eaa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dcc86c-01d7-4927-af3b-ec50432eaa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1085172295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40262c76-7a71-4449-9d8f-1c158d0f9719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='139d81c8e839419f88d71458a2e41c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:19:12Z,use_quota=True,user_id='17d691c592fe43a08060db31f419ca7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef726288-6452-45b8-ad8d-7f7c589243d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef726288-6452-45b8-ad8d-7f7c589243d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b08e2df-aabd-46f3-94f9-f947df6acf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b08e2df-aabd-46f3-94f9-f947df6acf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40262c76-7a71-4449-9d8f-1c158d0f9719', 'volume_name': 'volume-40262c76-7a71-4449-9d8f-1c158d0f9719', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7490e008-f40d-4a14-9fc1-adde9185c2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7490e008-f40d-4a14-9fc1-adde9185c2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75ec435-cad4-4341-a703-d0e700687245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:11 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Volume 40262c76-7a71-4449-9d8f-1c158d0f9719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40262c76-7a71-4449-9d8f-1c158d0f9719', 'volume_size': 1}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:19:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1085172295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40262c76-7a71-4449-9d8f-1c158d0f9719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='139d81c8e839419f88d71458a2e41c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:19:12Z,use_quota=True,user_id='17d691c592fe43a08060db31f419ca7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Creating volume 40262c76-7a71-4449-9d8f-1c158d0f9719 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:19:12 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-40262c76-7a71-4449-9d8f-1c158d0f9719 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:12 devstack quobyte-client[83411]: System call of process 90692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:19:12 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=14, name=volume-40262c76-7a71-4449-9d8f-1c158d0f9719, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-40262c76-7a71-4449-9d8f-1c158d0f9719 1073741824" returned: 0 in 0.485s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-40262c76-7a71-4449-9d8f-1c158d0f9719 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-40262c76-7a71-4449-9d8f-1c158d0f9719" returned: 0 in 0.188s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] <== create_volume: return (791ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:19:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:19:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75ec435-cad4-4341-a703-d0e700687245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40262c76-7a71-4449-9d8f-1c158d0f9719', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d421eb74-27ad-429e-b51f-c6224402cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:13 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Volume volume-40262c76-7a71-4449-9d8f-1c158d0f9719 (40262c76-7a71-4449-9d8f-1c158d0f9719): created successfully
Sep 16 11:19:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d421eb74-27ad-429e-b51f-c6224402cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Flow 'volume_create_manager' (76a8b98d-123f-4d05-8528-96609b44ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:19:13 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2dce613c-d531-4c82-ad0c-14fd0a970169 tempest-ServersNegativeTestJSON-345592531 None] Created volume successfully.
Sep 16 11:19:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:19:15 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:19:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Flow 'volume_create_manager' (1d138c75-4261-4ac6-977a-620b23e7ccf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:19:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1176a64-5429-4ef5-a643-5841b2935ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1176a64-5429-4ef5-a643-5841b2935ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2110790139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30633ef6-be9a-4a4e-a936-4bdba8510ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='139d81c8e839419f88d71458a2e41c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:19:16Z,use_quota=True,user_id='17d691c592fe43a08060db31f419ca7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d077f4d7-ea9a-4b54-95c5-b4d3a98231b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d077f4d7-ea9a-4b54-95c5-b4d3a98231b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5029cc-bf3e-42b4-8386-8a9460732fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5029cc-bf3e-42b4-8386-8a9460732fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30633ef6-be9a-4a4e-a936-4bdba8510ad0', 'volume_name': 'volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d932e735-e783-451c-8381-ad6605be835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d932e735-e783-451c-8381-ad6605be835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de73c67c-4282-4787-b7e2-c5d7f8be4560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:16 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Volume 30633ef6-be9a-4a4e-a936-4bdba8510ad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0', 'volume_size': 1}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2110790139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30633ef6-be9a-4a4e-a936-4bdba8510ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='139d81c8e839419f88d71458a2e41c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:19:16Z,use_quota=True,user_id='17d691c592fe43a08060db31f419ca7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Creating volume 30633ef6-be9a-4a4e-a936-4bdba8510ad0 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:19:16 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:16 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=15, name=volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0 1073741824" returned: 0 in 0.666s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0" returned: 0 in 0.150s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] <== create_volume: return (936ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:19:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:19:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de73c67c-4282-4787-b7e2-c5d7f8be4560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4516df97-d2a6-4ba2-9f07-af33dc884bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:17 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Volume volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0 (30633ef6-be9a-4a4e-a936-4bdba8510ad0): created successfully
Sep 16 11:19:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4516df97-d2a6-4ba2-9f07-af33dc884bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Flow 'volume_create_manager' (1d138c75-4261-4ac6-977a-620b23e7ccf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:19:17 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2013d504-06ec-47ca-9c4d-6a55e67a9c78 tempest-ServersNegativeTestJSON-345592531 None] Created volume successfully.
Sep 16 11:19:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Acquiring lock "cinder-30633ef6-be9a-4a4e-a936-4bdba8510ad0-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:19:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-0b7f0820-8582-4b95-bf99-f162739480fc req-a788954b-e6ea-4bcd-b6c2-6d9472aa7e7b tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:19:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Lock "cinder-30633ef6-be9a-4a4e-a936-4bdba8510ad0-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:19:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-0b7f0820-8582-4b95-bf99-f162739480fc req-a788954b-e6ea-4bcd-b6c2-6d9472aa7e7b tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:19:18 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-0b7f0820-8582-4b95-bf99-f162739480fc req-a788954b-e6ea-4bcd-b6c2-6d9472aa7e7b tempest-AttachVolumeNegativeTest-986806239 None] Terminate volume connection completed successfully.
Sep 16 11:19:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-0b7f0820-8582-4b95-bf99-f162739480fc req-a788954b-e6ea-4bcd-b6c2-6d9472aa7e7b tempest-AttachVolumeNegativeTest-986806239 None] Deleting attachment 6bb18c0a-0cea-42f0-8289-13dbb871b66a. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:19:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:19:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Acquiring lock "cinder-quobyte-30633ef6-be9a-4a4e-a936-4bdba8510ad0" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:19:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Lock "cinder-quobyte-30633ef6-be9a-4a4e-a936-4bdba8510ad0" acquired by "delete_volume" :: waited 0.043s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:19:18 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dfbb50-8450-4901-a50c-165b2d686dea]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:19:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0" returned: 0 in 1.006s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-30633ef6-be9a-4a4e-a936-4bdba8510ad0" returned: 0 in 0.229s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Lock "cinder-quobyte-30633ef6-be9a-4a4e-a936-4bdba8510ad0" released by "delete_volume" :: held 1.535s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:19:20 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Created reservations ['45018a8d-d27d-4efd-9cac-cbc1416696f9', 'dde437b5-1179-4018-bee9-be56ab00368b', 'ceed4fd4-6c24-4de6-baa5-3c999b2b3e95', '2a462241-2275-4881-8a5b-b2c006a509cd'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:19:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:19:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:19:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:19:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:19:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:19:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.216s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:21 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:19:21 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Deleted volume successfully.
Sep 16 11:19:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bacac6c5-c173-4244-b97f-b527108a724c tempest-ServersNegativeTestJSON-345592531 None] Lock "cinder-30633ef6-be9a-4a4e-a936-4bdba8510ad0-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:19:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Acquiring lock "cinder-40262c76-7a71-4449-9d8f-1c158d0f9719-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:19:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Lock "cinder-40262c76-7a71-4449-9d8f-1c158d0f9719-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:19:22 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:19:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Acquiring lock "cinder-quobyte-40262c76-7a71-4449-9d8f-1c158d0f9719" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:19:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Lock "cinder-quobyte-40262c76-7a71-4449-9d8f-1c158d0f9719" acquired by "delete_volume" :: waited 0.033s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:19:22 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[826b3678-bb4b-42e7-916a-203533b9a17a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:19:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-40262c76-7a71-4449-9d8f-1c158d0f9719 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:19:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:19:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.064s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:19:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:19:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:19:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.128s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:19:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:25 devstack quobyte-client[83411]: System call of process 90734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:19:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-40262c76-7a71-4449-9d8f-1c158d0f9719" returned: 0 in 3.222s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-40262c76-7a71-4449-9d8f-1c158d0f9719 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.674s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:19:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-40262c76-7a71-4449-9d8f-1c158d0f9719" returned: 0 in 0.444s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Lock "cinder-quobyte-40262c76-7a71-4449-9d8f-1c158d0f9719" released by "delete_volume" :: held 4.125s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:19:27 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Created reservations ['1ff17485-10c1-4f7c-865f-364ff9f825b6', '17db3514-9568-4808-b894-54e4f1474519', 'efeff9d5-60ec-4c33-9585-c6629759e897', '15f709d1-9ee7-4870-a1e2-67b3e4e5eb31'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:19:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:19:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:19:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:19:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:19:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.144s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:19:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.559s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:29 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:19:29 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Deleted volume successfully.
Sep 16 11:19:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-36d57b0f-41b9-4ab4-a9b0-9dadf2a60e42 tempest-ServersNegativeTestJSON-345592531 None] Lock "cinder-40262c76-7a71-4449-9d8f-1c158d0f9719-delete_volume" released by "delete_volume" :: held 8.005s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:19:37 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=13,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=7 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:19:40 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=13,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:19:54 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-4bd12290-a916-4824-b63a-959793dab9b8 tempest-GroupSnapshotsV319Test-1593058494 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:19:54 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-4bd12290-a916-4824-b63a-959793dab9b8 tempest-GroupSnapshotsV319Test-1593058494 None] Group tempest-GroupSnapshotsV319Test-Group-1911388086: creating
Sep 16 11:19:54 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-4bd12290-a916-4824-b63a-959793dab9b8 tempest-GroupSnapshotsV319Test-1593058494 None] Group tempest-GroupSnapshotsV319Test-Group-1911388086: created successfully
Sep 16 11:19:54 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-4bd12290-a916-4824-b63a-959793dab9b8 tempest-GroupSnapshotsV319Test-1593058494 None] Create group completed successfully.
Sep 16 11:19:56 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Flow 'volume_create_manager' (623d87d8-c3ff-47b5-9123-053bb4946f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5acb2a62-ee66-490b-b85e-0e31ec0075b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5acb2a62-ee66-490b-b85e-0e31ec0075b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120521546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ff0b69d4-a916-4232-955d-a7b30b1f6526,host='devstack@QuobyteHD#QuobyteHD',id=07f10865-51df-40ec-b040-fb38c9c21595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22a97b7b9184cd0adaaeea99087ba75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:19:56Z,use_quota=True,user_id='b2bc45e57a9045038c1ac3428879bc1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(724f5620-0745-4618-b797-cd70b8080d9f),volume_type_id=724f5620-0745-4618-b797-cd70b8080d9f)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fecd82-665e-4dec-89c3-4d1da7caccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fecd82-665e-4dec-89c3-4d1da7caccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9e2618-e44f-4889-b247-db370f08ceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9e2618-e44f-4889-b247-db370f08ceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07f10865-51df-40ec-b040-fb38c9c21595', 'volume_name': 'volume-07f10865-51df-40ec-b040-fb38c9c21595', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19871fb4-4b37-4e84-a3c6-73b70535b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19871fb4-4b37-4e84-a3c6-73b70535b918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d938f6b4-b461-44cb-b237-aca3c58ba77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:56 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Volume 07f10865-51df-40ec-b040-fb38c9c21595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07f10865-51df-40ec-b040-fb38c9c21595', 'volume_size': 1}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ff0b69d4-a916-4232-955d-a7b30b1f6526,created_at=2025-09-16T09:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120521546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ff0b69d4-a916-4232-955d-a7b30b1f6526,host='devstack@QuobyteHD#QuobyteHD',id=07f10865-51df-40ec-b040-fb38c9c21595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22a97b7b9184cd0adaaeea99087ba75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:19:56Z,use_quota=True,user_id='b2bc45e57a9045038c1ac3428879bc1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(724f5620-0745-4618-b797-cd70b8080d9f),volume_type_id=724f5620-0745-4618-b797-cd70b8080d9f)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Creating volume 07f10865-51df-40ec-b040-fb38c9c21595 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:19:56 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:19:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:56 devstack quobyte-client[83411]: System call of process 90892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:19:56 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=16, name=volume-07f10865-51df-40ec-b040-fb38c9c21595, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:19:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595 1073741824" returned: 0 in 0.562s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:19:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595" returned: 0 in 0.225s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:19:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] <== create_volume: return (864ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:19:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:19:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d938f6b4-b461-44cb-b237-aca3c58ba77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f10865-51df-40ec-b040-fb38c9c21595', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa037c37-5cfe-4712-a9f3-633eecd3fd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:19:57 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Volume volume-07f10865-51df-40ec-b040-fb38c9c21595 (07f10865-51df-40ec-b040-fb38c9c21595): created successfully
Sep 16 11:19:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa037c37-5cfe-4712-a9f3-633eecd3fd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:19:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Flow 'volume_create_manager' (623d87d8-c3ff-47b5-9123-053bb4946f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:19:57 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e5281381-4d77-4639-aad8-e7365f81844c tempest-GroupSnapshotsV319Test-1593058494 None] Created volume successfully.
Sep 16 11:19:59 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] GroupSnapshot 3989340d-cd68-4320-a6b8-fe6bbe95bf3c: creating.
Sep 16 11:19:59 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:19:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Group snapshot 3989340d-cd68-4320-a6b8-fe6bbe95bf3c: creating. {{(pid=83386) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 16 11:19:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:19:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:19:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Creating offline snapshot 4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f of volume 07f10865-51df-40ec-b040-fb38c9c21595 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:19:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9b7364-0416-43e8-bdfe-302c20ff05c6]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:19:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595" returned: 0 in 0.646s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:00 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=17, name=volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:20:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f 1G" returned: 0 in 0.368s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): qemu-img rebase -u -b volume-07f10865-51df-40ec-b040-fb38c9c21595 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] CMD "qemu-img rebase -u -b volume-07f10865-51df-40ec-b040-fb38c9c21595 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f" returned: 0 in 0.141s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:20:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f" returned: 0 in 0.078s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:20:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f" returned: 0 in 0.118s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.info" returned: 0 in 0.136s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:20:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.info" returned: 0 in 0.118s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:20:01 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d2482d3b-a53f-4987-90d2-59aeb20015c6 tempest-GroupSnapshotsV319Test-1593058494 None] group_snapshot 3989340d-cd68-4320-a6b8-fe6bbe95bf3c: created successfully
Sep 16 11:20:03 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] group_snapshot 3989340d-cd68-4320-a6b8-fe6bbe95bf3c: deleting
Sep 16 11:20:03 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:20:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] group_snapshot 3989340d-cd68-4320-a6b8-fe6bbe95bf3c: deleting {{(pid=83386) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 16 11:20:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Acquiring lock "cinder-quobyte-07f10865-51df-40ec-b040-fb38c9c21595" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:20:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Lock "cinder-quobyte-07f10865-51df-40ec-b040-fb38c9c21595" acquired by "delete_snapshot" :: waited 0.118s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:20:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Acquiring lock "cinder-quobyte-4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:20:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Lock "cinder-quobyte-4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:20:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Deleting offline snapshot 4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f of volume 07f10865-51df-40ec-b040-fb38c9c21595 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:20:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] snapshot_file for this snap is: volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:20:03 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafe48a1-cfee-48e2-b3f3-6d46488aec95]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:20:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:04 devstack quobyte-client[83411]: System call of process 90934 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:20:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f" returned: 0 in 1.311s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:05 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07f10865-51df-40ec-b040-fb38c9c21595(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:20:05 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f6bb2f-3199-41d9-90e1-ef4610dd21dd]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:20:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:06 devstack quobyte-client[83411]: System call of process 90954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:20:06 devstack quobyte-client[83411]: System call of process 90954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:20:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595" returned: 0 in 1.722s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:08 devstack quobyte-client[83411]: System call of process 90991 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:20:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f" returned: 0 in 1.472s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595.4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f" returned: 0 in 0.505s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Lock "cinder-quobyte-4b6c9e29-d2f2-44c6-b3a5-62753bfeb83f" released by "_delete_snapshot" :: held 6.048s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:20:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Lock "cinder-quobyte-07f10865-51df-40ec-b040-fb38c9c21595" released by "delete_snapshot" :: held 6.100s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:20:10 devstack cinder-volume[83386]: WARNING cinder.quota [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1782527677 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1782527677, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:20:10 devstack cinder-volume[83386]: WARNING cinder.quota [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1782527677 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1782527677, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:20:10 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] Created reservations ['b3e43597-aec9-43a7-b303-13ed463e3748', 'bcd4d093-43e2-4f0e-840f-fac67db70f6d', 'b98d4c0e-7695-4170-a966-7ba6d51dcad6', '72f4b172-8667-486c-887d-7b8058c19a97'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:20:10 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fade66df-3047-4761-b198-76931f7c862d tempest-GroupSnapshotsV319Test-1593058494 None] group_snapshot 3989340d-cd68-4320-a6b8-fe6bbe95bf3c: deleted successfully
Sep 16 11:20:12 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:20:12 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Acquiring lock "cinder-quobyte-07f10865-51df-40ec-b040-fb38c9c21595" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:20:12 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Lock "cinder-quobyte-07f10865-51df-40ec-b040-fb38c9c21595" acquired by "delete_volume" :: waited 0.092s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:20:12 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad886e6-4df9-4a67-b014-108ae95e76bc]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:20:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595" returned: 0 in 1.798s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f10865-51df-40ec-b040-fb38c9c21595" returned: 0 in 0.301s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Lock "cinder-quobyte-07f10865-51df-40ec-b040-fb38c9c21595" released by "delete_volume" :: held 2.628s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:20:15 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Created reservations ['aee1c676-89d5-4195-903d-25997a8039f1'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:20:15 devstack cinder-volume[83386]: WARNING cinder.quota [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1782527677 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1782527677, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:20:16 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Created reservations ['0390a1c2-6720-45f1-ba8b-e4cdd6accd89', 'de80d38f-8249-4174-9f0b-2c57831d3cd2', 'da626e16-f5d1-4152-9a54-020c2c337075', '7615197b-7c61-4a3f-8511-015ee799bd83'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:20:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:20:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:20:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:20:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:20:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:20:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.113s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:16 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:20:16 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d4041425-d919-44b6-805b-4181a891165a tempest-GroupSnapshotsV319Test-1593058494 None] Delete group completed successfully.
Sep 16 11:20:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "cinder-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:20:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "cinder-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:20:22 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:20:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "cinder-quobyte-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:20:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "cinder-quobyte-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0" acquired by "delete_volume" :: waited 0.020s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:20:22 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e075ad26-569e-46d8-b52a-a77bc5c25b77]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:20:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0" returned: 0 in 0.725s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0" returned: 0 in 0.126s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "cinder-quobyte-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0" released by "delete_volume" :: held 1.025s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:20:23 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Created reservations ['d53e9788-a0fe-42a1-89f3-cc3d2d6d28a5', 'c60854b3-9eaa-4060-b4d0-b3e9debb5d3a', '0741c4d6-26bf-4fcc-8e22-1718dda0a6fc', 'aded628f-6b25-4d98-8652-ef5e68699733'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:20:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:20:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:20:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:20:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:20:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:20:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.122s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:23 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:20:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Deleted volume successfully.
Sep 16 11:20:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f9469ed2-c8d6-436f-8c98-4a3c37cd26d8 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "cinder-7f3eedd2-3d1b-4363-a98b-e4ac2f9c55a0-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:20:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "cinder-a428ed6b-03b9-4a1b-bd1e-7e10b641a705-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:20:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "cinder-a428ed6b-03b9-4a1b-bd1e-7e10b641a705-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:20:25 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "cinder-quobyte-a428ed6b-03b9-4a1b-bd1e-7e10b641a705" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "cinder-quobyte-a428ed6b-03b9-4a1b-bd1e-7e10b641a705" acquired by "delete_volume" :: waited 0.017s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c77b6d-2e37-4be9-b649-a107ebf2f623]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.282s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705" returned: 0 in 0.770s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a428ed6b-03b9-4a1b-bd1e-7e10b641a705" returned: 0 in 0.145s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "cinder-quobyte-a428ed6b-03b9-4a1b-bd1e-7e10b641a705" released by "delete_volume" :: held 1.107s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:20:26 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Created reservations ['66822a7b-3cf5-446c-8b08-0dc61e6f927d', 'c947955c-4970-49e3-b36e-90e8484abdc9', '95d52453-3631-4c09-a625-3fcb2b97549f', '0d62cc62-c626-4c13-8ae6-c9097d8c267f'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:20:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:20:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:20:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:20:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:20:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:20:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:20:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.110s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:20:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:20:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Deleted volume successfully.
Sep 16 11:20:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf35177-e247-44ab-a0c2-2bd26cfce978 tempest-AttachVolumeShelveTestJSON-1697274340 None] Lock "cinder-a428ed6b-03b9-4a1b-bd1e-7e10b641a705-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:20:36 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=33,cinder:UPDATE=51,cinder:DELETE=1,cinder:INSERT=10 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:20:37 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=35,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:21:00 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Flow 'volume_create_manager' (e1ea0a6b-e935-4170-aa02-4e6e316596f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4e33e5-b76e-431c-b7e2-6e7a1a490065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4e33e5-b76e-431c-b7e2-6e7a1a490065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-229196136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6bea24-0b3e-4fa2-96e2-38375ed86190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82994a0675ee405980a472d75dfe8751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:21:01Z,use_quota=True,user_id='c160441b3c4942a4abfe4bcdffe4c5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c9ad72-3c6a-4bfa-8bd1-0576cf736e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c9ad72-3c6a-4bfa-8bd1-0576cf736e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee71a726-f0ae-41e4-8475-f7e5a231c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee71a726-f0ae-41e4-8475-f7e5a231c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6bea24-0b3e-4fa2-96e2-38375ed86190', 'volume_name': 'volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329a7b1f-278f-4e9b-9312-e8071a3cf2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329a7b1f-278f-4e9b-9312-e8071a3cf2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4ce7cb-9767-4d08-ac90-d2083ef491c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:00 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Volume 0a6bea24-0b3e-4fa2-96e2-38375ed86190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190', 'volume_size': 1}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-229196136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6bea24-0b3e-4fa2-96e2-38375ed86190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82994a0675ee405980a472d75dfe8751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:21:01Z,use_quota=True,user_id='c160441b3c4942a4abfe4bcdffe4c5d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Creating volume 0a6bea24-0b3e-4fa2-96e2-38375ed86190 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:21:00 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:21:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:01 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=19, name=volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:21:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190 1073741824" returned: 0 in 0.441s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190" returned: 0 in 0.184s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] <== create_volume: return (744ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:21:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4ce7cb-9767-4d08-ac90-d2083ef491c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e91d28b-529c-4a67-a660-07551c0c9770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:02 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Volume volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190 (0a6bea24-0b3e-4fa2-96e2-38375ed86190): created successfully
Sep 16 11:21:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e91d28b-529c-4a67-a660-07551c0c9770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Flow 'volume_create_manager' (e1ea0a6b-e935-4170-aa02-4e6e316596f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:21:02 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-9f6599a5-6378-4b83-ba5e-44e80a52ddc3 tempest-VolumesServicesTestJSON-2025865964 None] Created volume successfully.
Sep 16 11:21:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Acquiring lock "cinder-0a6bea24-0b3e-4fa2-96e2-38375ed86190-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:21:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Lock "cinder-0a6bea24-0b3e-4fa2-96e2-38375ed86190-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:21:03 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:21:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Acquiring lock "cinder-quobyte-0a6bea24-0b3e-4fa2-96e2-38375ed86190" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:21:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Lock "cinder-quobyte-0a6bea24-0b3e-4fa2-96e2-38375ed86190" acquired by "delete_volume" :: waited 0.017s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:21:03 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb88c2c8-988c-47cd-ad2f-563b5f22ce25]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:21:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190" returned: 0 in 0.567s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0a6bea24-0b3e-4fa2-96e2-38375ed86190" returned: 0 in 0.115s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Lock "cinder-quobyte-0a6bea24-0b3e-4fa2-96e2-38375ed86190" released by "delete_volume" :: held 0.885s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:21:05 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Created reservations ['bd1cdd4e-d9f3-4a2c-8360-0af3ec89aa4f', 'd57f0f59-ece1-4aeb-b957-832e9fba1948', 'f7bf238f-d189-4da1-bf73-c2ee8545d9f3', 'e7fc1a58-d998-4318-939b-3832566625a6'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:21:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:05 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:21:05 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:21:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.140s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:05 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:21:05 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Deleted volume successfully.
Sep 16 11:21:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-474e2d1a-348c-4893-94f5-c01c276845bc tempest-VolumesServicesTestJSON-2025865964 None] Lock "cinder-0a6bea24-0b3e-4fa2-96e2-38375ed86190-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:21:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:21:14 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:21:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Flow 'volume_create_manager' (a68405d1-f334-4528-90ba-b6b2d81fb563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:21:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5be3738-1a88-4386-98c4-9a234d9058d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5be3738-1a88-4386-98c4-9a234d9058d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1403009602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1349774b-fb58-40e1-bea9-9ce798fb87a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac3b1f25b3994e4bac032406449ad7a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:21:14Z,use_quota=True,user_id='5068757883f74f21825932b62f39fc1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f4d986-4b99-4246-8bd6-8597e19c35b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f4d986-4b99-4246-8bd6-8597e19c35b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad28e378-f65c-4b4c-a116-6b90ec2363a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad28e378-f65c-4b4c-a116-6b90ec2363a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1349774b-fb58-40e1-bea9-9ce798fb87a3', 'volume_name': 'volume-1349774b-fb58-40e1-bea9-9ce798fb87a3', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075d6f54-d20b-4e04-8988-809dec958dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (075d6f54-d20b-4e04-8988-809dec958dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fde956b-8ea8-4c5f-8de3-29fa5373dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:15 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Volume 1349774b-fb58-40e1-bea9-9ce798fb87a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1349774b-fb58-40e1-bea9-9ce798fb87a3', 'volume_size': 1}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1403009602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1349774b-fb58-40e1-bea9-9ce798fb87a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac3b1f25b3994e4bac032406449ad7a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:21:14Z,use_quota=True,user_id='5068757883f74f21825932b62f39fc1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Creating volume 1349774b-fb58-40e1-bea9-9ce798fb87a3 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:21:15 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:15 devstack quobyte-client[83411]: System call of process 91195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:21:15 devstack quobyte-client[83411]: System call of process 91195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:21:15 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=20, name=volume-1349774b-fb58-40e1-bea9-9ce798fb87a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 1073741824" returned: 0 in 0.563s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3" returned: 0 in 0.267s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] <== create_volume: return (1091ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:21:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fde956b-8ea8-4c5f-8de3-29fa5373dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1349774b-fb58-40e1-bea9-9ce798fb87a3', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5407ba8d-1abb-49c2-94ee-e7a9393c4a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:16 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Volume volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 (1349774b-fb58-40e1-bea9-9ce798fb87a3): created successfully
Sep 16 11:21:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5407ba8d-1abb-49c2-94ee-e7a9393c4a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Flow 'volume_create_manager' (a68405d1-f334-4528-90ba-b6b2d81fb563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:21:16 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fe429ebd-0f0a-420c-b7a2-b68e6c583d24 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Created volume successfully.
Sep 16 11:21:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:21:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Creating offline snapshot 7662a41d-304a-468e-81e8-632c9af97fea of volume 1349774b-fb58-40e1-bea9-9ce798fb87a3 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:21:18 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[401a0697-4cba-4b70-9211-1980371f2648]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:21:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3" returned: 0 in 0.667s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:19 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=21, name=volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea 1G" returned: 0 in 0.248s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "qemu-img rebase -u -b volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea" returned: 0 in 0.159s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea" returned: 0 in 0.117s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea" returned: 0 in 0.094s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.info" returned: 0 in 0.079s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:21:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.info" returned: 0 in 0.079s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-aa5bd56e-d577-427e-8102-f89476c87f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Create snapshot completed successfully
Sep 16 11:21:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Acquiring lock "cinder-7662a41d-304a-468e-81e8-632c9af97fea-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:21:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "cinder-7662a41d-304a-468e-81e8-632c9af97fea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:21:21 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:21:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Acquiring lock "cinder-quobyte-1349774b-fb58-40e1-bea9-9ce798fb87a3" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:21:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "cinder-quobyte-1349774b-fb58-40e1-bea9-9ce798fb87a3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:21:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Acquiring lock "cinder-quobyte-7662a41d-304a-468e-81e8-632c9af97fea" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:21:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "cinder-quobyte-7662a41d-304a-468e-81e8-632c9af97fea" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:21:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Deleting offline snapshot 7662a41d-304a-468e-81e8-632c9af97fea of volume 1349774b-fb58-40e1-bea9-9ce798fb87a3 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:21:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] snapshot_file for this snap is: volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:21:22 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaf4cc7-1919-46e8-b8ab-13a6063bdce6]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:21:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:22 devstack quobyte-client[83411]: System call of process 91225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:21:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea" returned: 0 in 0.550s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1349774b-fb58-40e1-bea9-9ce798fb87a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:21:22 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad7e3d7-053f-4852-b6be-111f5ddbd9ac]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:21:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:23 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:21:23 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:21:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Flow 'volume_create_manager' (330da708-82ac-4bcf-8385-aa9b66a93f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:21:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62872dd8-f466-4a0a-8a1b-ed7a993cecbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3" returned: 0 in 0.813s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62872dd8-f466-4a0a-8a1b-ed7a993cecbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1517189579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64901c6b-f520-46d7-8fc7-e68eba13b544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aec70fab6fb4b9ca06ea75896833147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:21:23Z,use_quota=True,user_id='910c89a52d2945e8a37c3d07db988604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c6e12a-da0e-4bca-be6e-64752eb1583e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c6e12a-da0e-4bca-be6e-64752eb1583e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e9ea29-a608-4e69-9f35-456bb409ce6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e9ea29-a608-4e69-9f35-456bb409ce6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64901c6b-f520-46d7-8fc7-e68eba13b544', 'volume_name': 'volume-64901c6b-f520-46d7-8fc7-e68eba13b544', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f7b9a5-c259-4f9b-b562-beadb69c8ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f7b9a5-c259-4f9b-b562-beadb69c8ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3763474-a619-4172-89b2-0df02c9563b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:24 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Volume 64901c6b-f520-46d7-8fc7-e68eba13b544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64901c6b-f520-46d7-8fc7-e68eba13b544', 'volume_size': 1}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1517189579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64901c6b-f520-46d7-8fc7-e68eba13b544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0aec70fab6fb4b9ca06ea75896833147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:21:23Z,use_quota=True,user_id='910c89a52d2945e8a37c3d07db988604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Creating volume 64901c6b-f520-46d7-8fc7-e68eba13b544 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:21:24 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-64901c6b-f520-46d7-8fc7-e68eba13b544 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:24 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=23, name=volume-64901c6b-f520-46d7-8fc7-e68eba13b544, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea" returned: 0 in 1.285s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:21:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:21:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:21:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.096s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-64901c6b-f520-46d7-8fc7-e68eba13b544 1073741824" returned: 0 in 1.716s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-64901c6b-f520-46d7-8fc7-e68eba13b544 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3.7662a41d-304a-468e-81e8-632c9af97fea" returned: 0 in 1.506s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 1.008s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:21:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "cinder-quobyte-7662a41d-304a-468e-81e8-632c9af97fea" released by "_delete_snapshot" :: held 4.774s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:21:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-64901c6b-f520-46d7-8fc7-e68eba13b544" returned: 0 in 0.501s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] <== create_volume: return (2332ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:21:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.398s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "cinder-quobyte-1349774b-fb58-40e1-bea9-9ce798fb87a3" released by "delete_snapshot" :: held 4.960s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3763474-a619-4172-89b2-0df02c9563b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64901c6b-f520-46d7-8fc7-e68eba13b544', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d945af94-17fc-49cd-9d1d-d839f505f316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:27 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Volume volume-64901c6b-f520-46d7-8fc7-e68eba13b544 (64901c6b-f520-46d7-8fc7-e68eba13b544): created successfully
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d945af94-17fc-49cd-9d1d-d839f505f316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Flow 'volume_create_manager' (330da708-82ac-4bcf-8385-aa9b66a93f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:21:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fbbba2ac-58b5-4dea-8247-76bde130902c tempest-AttachVolumeNegativeTest-986806239 None] Created volume successfully.
Sep 16 11:21:27 devstack cinder-volume[83386]: WARNING cinder.quota [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Created reservations ['272953df-c953-43df-a80c-9843d3abe888', 'ece2a4a4-b6ac-4e7d-ac38-3324707228b7', '84dfe548-22a5-46e9-b940-3528d48282fe', '848dd3ff-5ae4-47c7-bb18-03c0dda22781'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:21:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Delete snapshot completed successfully.
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04b03004-d245-459e-9ffe-65e9d931ae74 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "cinder-7662a41d-304a-468e-81e8-632c9af97fea-delete_snapshot" released by "delete_snapshot" :: held 5.587s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Acquiring lock "cinder-1349774b-fb58-40e1-bea9-9ce798fb87a3-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "cinder-1349774b-fb58-40e1-bea9-9ce798fb87a3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:21:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Acquiring lock "cinder-quobyte-1349774b-fb58-40e1-bea9-9ce798fb87a3" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "cinder-quobyte-1349774b-fb58-40e1-bea9-9ce798fb87a3" acquired by "delete_volume" :: waited 0.017s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4feae3d-81de-477e-b11c-78b58c591ed5]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:21:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3" returned: 0 in 0.740s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1349774b-fb58-40e1-bea9-9ce798fb87a3" returned: 0 in 0.172s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:29 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "cinder-quobyte-1349774b-fb58-40e1-bea9-9ce798fb87a3" released by "delete_volume" :: held 1.245s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:21:29 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Created reservations ['8d7814a1-ae24-4fdb-b0c0-671688e346b2', '31ae03fc-7b84-4874-a7f9-07bb67a82ebe', '2ae87258-7992-48b9-809b-d68aa479d39e', 'd8446e0d-ccdc-439f-b301-d7f46afdbbaa'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:21:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:21:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:21:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.109s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:30 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:21:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Deleted volume successfully.
Sep 16 11:21:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-202ecdc8-1c4b-4762-b554-dea126691771 tempest-VolumeSnapshotQuotasNegativeTestJSON-646997660 None] Lock "cinder-1349774b-fb58-40e1-bea9-9ce798fb87a3-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:21:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-17594c53-baee-42fb-b0f5-5928246341bd req-d976db62-f95e-49de-be34-8dcbdcdb9073 tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-17594c53-baee-42fb-b0f5-5928246341bd req-d976db62-f95e-49de-be34-8dcbdcdb9073 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:32 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5b3448-d58f-44bb-94ad-44e38d42f8eb]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:21:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-17594c53-baee-42fb-b0f5-5928246341bd req-d976db62-f95e-49de-be34-8dcbdcdb9073 tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-64901c6b-f520-46d7-8fc7-e68eba13b544 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-17594c53-baee-42fb-b0f5-5928246341bd req-d976db62-f95e-49de-be34-8dcbdcdb9073 tempest-AttachVolumeNegativeTest-986806239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-64901c6b-f520-46d7-8fc7-e68eba13b544" returned: 0 in 1.738s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-17594c53-baee-42fb-b0f5-5928246341bd req-d976db62-f95e-49de-be34-8dcbdcdb9073 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.925s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-17594c53-baee-42fb-b0f5-5928246341bd req-d976db62-f95e-49de-be34-8dcbdcdb9073 tempest-AttachVolumeNegativeTest-986806239 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-64901c6b-f520-46d7-8fc7-e68eba13b544', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e503cad8-f510-48ab-8dcb-ccf7dfeee356', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:21:34 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-17594c53-baee-42fb-b0f5-5928246341bd req-d976db62-f95e-49de-be34-8dcbdcdb9073 tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:21:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-17594c53-baee-42fb-b0f5-5928246341bd req-d976db62-f95e-49de-be34-8dcbdcdb9073 tempest-AttachVolumeNegativeTest-986806239 None] attachment_update completed successfully.
Sep 16 11:21:44 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Flow 'volume_create_manager' (224ca685-b9ab-40a6-991b-9c3229f2552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d544a93-9de8-48be-91d7-462765239d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d544a93-9de8-48be-91d7-462765239d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1226361649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c17adb0-fa9c-426d-90d8-8273522d7ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a502b0ed9400fa452f6751b864a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:21:44Z,use_quota=True,user_id='bb645f6d0e184007b4c0b250d92ca6cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f5e62d9-d86f-4b70-be5c-bb06d1eec9c4),volume_type_id=9f5e62d9-d86f-4b70-be5c-bb06d1eec9c4)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b0aa49-bffb-4cdc-81db-62860b206259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b0aa49-bffb-4cdc-81db-62860b206259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3169c4cc-d896-4fbb-9964-5c7f7f565922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3169c4cc-d896-4fbb-9964-5c7f7f565922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c17adb0-fa9c-426d-90d8-8273522d7ce9', 'volume_name': 'volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3d824d-788b-4630-99c7-fe8580b77fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3d824d-788b-4630-99c7-fe8580b77fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4a503d-eed2-46dc-99e7-2fce9fb295de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:44 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Volume 0c17adb0-fa9c-426d-90d8-8273522d7ce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9', 'volume_size': 1}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1226361649',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c17adb0-fa9c-426d-90d8-8273522d7ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107a502b0ed9400fa452f6751b864a51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:21:44Z,use_quota=True,user_id='bb645f6d0e184007b4c0b250d92ca6cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f5e62d9-d86f-4b70-be5c-bb06d1eec9c4),volume_type_id=9f5e62d9-d86f-4b70-be5c-bb06d1eec9c4)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Creating volume 0c17adb0-fa9c-426d-90d8-8273522d7ce9 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:21:44 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:44 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=24, name=volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9 1073741824" returned: 0 in 0.389s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9" returned: 0 in 0.205s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] <== create_volume: return (728ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:21:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4a503d-eed2-46dc-99e7-2fce9fb295de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65059777-43e4-4c58-83ad-d73526f71159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:21:45 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Volume volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9 (0c17adb0-fa9c-426d-90d8-8273522d7ce9): created successfully
Sep 16 11:21:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65059777-43e4-4c58-83ad-d73526f71159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:21:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Flow 'volume_create_manager' (224ca685-b9ab-40a6-991b-9c3229f2552c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:21:45 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-0af04099-069b-447d-866a-e32fb9c40c7d tempest-VolumeTypesAccessTest-1137716727 None] Created volume successfully.
Sep 16 11:21:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Acquiring lock "cinder-0c17adb0-fa9c-426d-90d8-8273522d7ce9-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:21:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Lock "cinder-0c17adb0-fa9c-426d-90d8-8273522d7ce9-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:21:46 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:21:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Acquiring lock "cinder-quobyte-0c17adb0-fa9c-426d-90d8-8273522d7ce9" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:21:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Lock "cinder-quobyte-0c17adb0-fa9c-426d-90d8-8273522d7ce9" acquired by "delete_volume" :: waited 0.020s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:21:46 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff6e571-67be-4831-aa00-bf5d798d1799]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:21:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9" returned: 0 in 0.519s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0c17adb0-fa9c-426d-90d8-8273522d7ce9" returned: 0 in 0.089s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Lock "cinder-quobyte-0c17adb0-fa9c-426d-90d8-8273522d7ce9" released by "delete_volume" :: held 0.774s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:21:47 devstack cinder-volume[83386]: WARNING cinder.quota [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-347758323 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-347758323, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:21:47 devstack cinder-volume[83386]: WARNING cinder.quota [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-347758323 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-347758323, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Created reservations ['77042d65-6c66-4fef-9b43-17c76e3e67b5', 'e7c282f0-27b1-4d13-a45c-6d10167e46be', 'dfbed5bc-45e0-4df4-bf66-3d4ba7047ad4', 'a7ccbcaa-12be-4325-92c5-4977de1dde28'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:21:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:21:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.127s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:21:48 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:21:48 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Deleted volume successfully.
Sep 16 11:21:48 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e764b0ab-d50e-4e74-a6d2-f48480c154dd tempest-VolumeTypesAccessTest-1137716727 None] Lock "cinder-0c17adb0-fa9c-426d-90d8-8273522d7ce9-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:21:57 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=46,cinder:DELETE=6,cinder:SELECT=33,cinder:INSERT=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:21:58 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=28,cinder:UPDATE=34,cinder:INSERT=12,cinder:DELETE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:22:07 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-e56c4a45-ca39-4877-89f2-dc8d706703d3 req-971b943d-36c2-4c2b-a988-90745a567810 tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:07 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-e56c4a45-ca39-4877-89f2-dc8d706703d3 req-971b943d-36c2-4c2b-a988-90745a567810 tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:07 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-e56c4a45-ca39-4877-89f2-dc8d706703d3 req-971b943d-36c2-4c2b-a988-90745a567810 tempest-AttachVolumeNegativeTest-986806239 None] Terminate volume connection completed successfully.
Sep 16 11:22:07 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-e56c4a45-ca39-4877-89f2-dc8d706703d3 req-971b943d-36c2-4c2b-a988-90745a567810 tempest-AttachVolumeNegativeTest-986806239 None] Deleting attachment e503cad8-f510-48ab-8dcb-ccf7dfeee356. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:22:13 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Flow 'volume_create_manager' (7f2ae095-3399-44ef-9918-e91b071ea773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62769e34-85b1-478f-8ddd-a10f50d5000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62769e34-85b1-478f-8ddd-a10f50d5000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-719936822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bad1c8f-7007-4810-a4dc-d0495c8cc85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc6f7fc6b7a4e1b978f19f85c6c2277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:22:13Z,use_quota=True,user_id='6b5801eeadd848ebbdfb685d8a35247b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87d657d-1eb5-4000-8782-abb2875a2360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87d657d-1eb5-4000-8782-abb2875a2360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c282bacc-2b64-42fd-a22a-d6d45e288b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c282bacc-2b64-42fd-a22a-d6d45e288b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bad1c8f-7007-4810-a4dc-d0495c8cc85d', 'volume_name': 'volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2553609f-5f64-4ad0-9455-3adcf3513db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2553609f-5f64-4ad0-9455-3adcf3513db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08ca8e9-9d7b-4506-abf9-ceeaba41fe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:13 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Volume 0bad1c8f-7007-4810-a4dc-d0495c8cc85d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d', 'volume_size': 1}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-719936822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bad1c8f-7007-4810-a4dc-d0495c8cc85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fc6f7fc6b7a4e1b978f19f85c6c2277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:22:13Z,use_quota=True,user_id='6b5801eeadd848ebbdfb685d8a35247b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Creating volume 0bad1c8f-7007-4810-a4dc-d0495c8cc85d {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:22:13 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:13 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=25, name=volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d 1073741824" returned: 0 in 0.524s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d" returned: 0 in 0.148s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] <== create_volume: return (873ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:22:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08ca8e9-9d7b-4506-abf9-ceeaba41fe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9423c4d6-257e-497b-a8bb-e7fd58b3d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:14 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Volume volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d (0bad1c8f-7007-4810-a4dc-d0495c8cc85d): created successfully
Sep 16 11:22:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9423c4d6-257e-497b-a8bb-e7fd58b3d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Flow 'volume_create_manager' (7f2ae095-3399-44ef-9918-e91b071ea773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:22:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-281473d2-b7a7-4a37-a3b9-0c62845c627e tempest-AbsoluteLimitsTests-1175965902 None] Created volume successfully.
Sep 16 11:22:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Acquiring lock "cinder-0bad1c8f-7007-4810-a4dc-d0495c8cc85d-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:22:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Lock "cinder-0bad1c8f-7007-4810-a4dc-d0495c8cc85d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:22:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Acquiring lock "cinder-quobyte-0bad1c8f-7007-4810-a4dc-d0495c8cc85d" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:22:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Lock "cinder-quobyte-0bad1c8f-7007-4810-a4dc-d0495c8cc85d" acquired by "delete_volume" :: waited 0.049s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:22:15 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab0dee-cdf0-4960-9672-1bfafedb702f]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:22:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d" returned: 0 in 0.550s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0bad1c8f-7007-4810-a4dc-d0495c8cc85d" returned: 0 in 0.088s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Lock "cinder-quobyte-0bad1c8f-7007-4810-a4dc-d0495c8cc85d" released by "delete_volume" :: held 0.832s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Created reservations ['6e665a5e-fa0f-4d46-9ae9-f0994fb9850b', '7a3319e9-e668-483a-8287-94ebf27d3be2', 'ec58f357-1fc2-47a0-a541-0a91ed0201be', '6b63f5a1-a871-4241-beb5-7d9db86c4d5c'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.080s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:17 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:22:17 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Deleted volume successfully.
Sep 16 11:22:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e822edff-a795-4d66-be63-634f484574aa tempest-AbsoluteLimitsTests-1175965902 None] Lock "cinder-0bad1c8f-7007-4810-a4dc-d0495c8cc85d-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:22:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "cinder-64901c6b-f520-46d7-8fc7-e68eba13b544-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:22:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-64901c6b-f520-46d7-8fc7-e68eba13b544-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:22:23 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:23 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Flow 'volume_create_manager' (b5b787d0-bec8-4f8d-9f87-2325ef1f4ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313c38fe-6990-4889-8fe9-c5fb169c6ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "cinder-quobyte-64901c6b-f520-46d7-8fc7-e68eba13b544" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313c38fe-6990-4889-8fe9-c5fb169c6ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-847925417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72380b75-1565-478c-aa9d-b1d81ebf1cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ef85e3fb4849bcbaf6216ec665aa01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:22:24Z,use_quota=True,user_id='1a16bce0bd7d42f79a9e9777ad5cdd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08bafb7-8eca-4df0-8e46-5e23bc51beb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d08bafb7-8eca-4df0-8e46-5e23bc51beb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94a947f-48e3-4b81-a906-4946fad7ed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94a947f-48e3-4b81-a906-4946fad7ed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72380b75-1565-478c-aa9d-b1d81ebf1cb7', 'volume_name': 'volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3018faaf-2cb2-4386-b10b-aaea7cf7165e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3018faaf-2cb2-4386-b10b-aaea7cf7165e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f040b857-d305-426c-8c8c-aebe0c776133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:24 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Volume 72380b75-1565-478c-aa9d-b1d81ebf1cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7', 'volume_size': 1}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-847925417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72380b75-1565-478c-aa9d-b1d81ebf1cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ef85e3fb4849bcbaf6216ec665aa01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:22:24Z,use_quota=True,user_id='1a16bce0bd7d42f79a9e9777ad5cdd29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Creating volume 72380b75-1565-478c-aa9d-b1d81ebf1cb7 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:22:24 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:24 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=26, name=volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-quobyte-64901c6b-f520-46d7-8fc7-e68eba13b544" acquired by "delete_volume" :: waited 0.270s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[8527207c-8c99-4356-87f5-fa9aae66e3e8]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-64901c6b-f520-46d7-8fc7-e68eba13b544 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7 1073741824" returned: 0 in 0.507s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7" returned: 0 in 0.132s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] <== create_volume: return (719ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:22:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f040b857-d305-426c-8c8c-aebe0c776133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5804e29e-d0c9-40a0-aa12-37c92d1b78ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:25 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Volume volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7 (72380b75-1565-478c-aa9d-b1d81ebf1cb7): created successfully
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5804e29e-d0c9-40a0-aa12-37c92d1b78ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Flow 'volume_create_manager' (b5b787d0-bec8-4f8d-9f87-2325ef1f4ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:22:25 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-23f56f4c-be66-4e23-be97-2ed6cf121dc8 tempest-VolumesMetadataTest-1043121317 None] Created volume successfully.
Sep 16 11:22:25 devstack quobyte-client[83411]: System call of process 91911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-64901c6b-f520-46d7-8fc7-e68eba13b544" returned: 0 in 0.808s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-64901c6b-f520-46d7-8fc7-e68eba13b544 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-64901c6b-f520-46d7-8fc7-e68eba13b544" returned: 0 in 0.086s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-quobyte-64901c6b-f520-46d7-8fc7-e68eba13b544" released by "delete_volume" :: held 1.095s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.280s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:22:26 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Created reservations ['5e132165-0c36-4d4a-8080-906106b6b417', '142dda52-f402-45fb-b085-3326ab59619d', 'e1247175-1f98-43c8-97c8-55acca5c0aaa', '3ed8d203-630f-49bf-b533-2c5ef3226f81'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:22:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:22:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:22:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.122s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:22:26 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Deleted volume successfully.
Sep 16 11:22:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6efca4f7-c353-4149-a7f7-28e1f65a335a tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-64901c6b-f520-46d7-8fc7-e68eba13b544-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Acquiring lock "cinder-72380b75-1565-478c-aa9d-b1d81ebf1cb7-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "cinder-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Lock "cinder-72380b75-1565-478c-aa9d-b1d81ebf1cb7-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:22:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "cinder-quobyte-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:22:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Acquiring lock "cinder-quobyte-72380b75-1565-478c-aa9d-b1d81ebf1cb7" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-quobyte-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a" acquired by "delete_volume" :: waited 0.024s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Lock "cinder-quobyte-72380b75-1565-478c-aa9d-b1d81ebf1cb7" acquired by "delete_volume" :: waited 0.032s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b7dff0-8c52-46a2-b73a-443d1b0e668c]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10ac41d-460f-4d8a-8ca2-e3b0e7e0c7cb]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:22:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a" returned: 0 in 0.565s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7" returned: 0 in 0.609s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a" returned: 0 in 0.323s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-72380b75-1565-478c-aa9d-b1d81ebf1cb7" returned: 0 in 0.257s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-quobyte-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a" released by "delete_volume" :: held 1.035s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:22:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Lock "cinder-quobyte-72380b75-1565-478c-aa9d-b1d81ebf1cb7" released by "delete_volume" :: held 1.192s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Created reservations ['aa2fbf8e-f8bd-4568-ba47-448515d83869', '2b7ce5c9-5c3e-42ed-bdfb-b5dd678bc3d3', '7e576350-a368-4a9a-a815-2786c1e2daf4', '5a0f15fb-f6e3-49b6-b0bc-f7642c4a3927'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Created reservations ['e94a5ce9-c6f2-49a5-b1ed-748133749816', '99a2c8e2-af02-4400-94bf-4f9ddd152226', '0da30ce1-6f9b-4227-8b75-c7da1580f8b5', 'ded87f04-aa17-4e7c-a094-3f83b840e19b'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.173s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:22:29 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Deleted volume successfully.
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.157s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:22:29 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6b699e5c-fc78-440d-ba0e-f96623031049 tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-a193348f-6e0d-4ba2-9d7a-4ba1018cfc4a-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:22:29 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Deleted volume successfully.
Sep 16 11:22:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-350dbb9d-a935-4b44-b094-51d0e04b9318 tempest-VolumesMetadataTest-1043121317 None] Lock "cinder-72380b75-1565-478c-aa9d-b1d81ebf1cb7-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:22:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "cinder-1ab289b4-6387-4684-a9c1-87e1781ebc11-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:22:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-1ab289b4-6387-4684-a9c1-87e1781ebc11-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:22:30 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "cinder-quobyte-1ab289b4-6387-4684-a9c1-87e1781ebc11" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:22:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-quobyte-1ab289b4-6387-4684-a9c1-87e1781ebc11" acquired by "delete_volume" :: waited 0.021s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:22:30 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08a868c-5b26-4f1b-8da4-0563d6781782]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:22:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ab289b4-6387-4684-a9c1-87e1781ebc11 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ab289b4-6387-4684-a9c1-87e1781ebc11" returned: 0 in 0.504s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ab289b4-6387-4684-a9c1-87e1781ebc11 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ab289b4-6387-4684-a9c1-87e1781ebc11" returned: 0 in 0.202s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-quobyte-1ab289b4-6387-4684-a9c1-87e1781ebc11" released by "delete_volume" :: held 0.956s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:22:32 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Created reservations ['62ffa2ff-4a16-4127-8680-f944143c9283', '3a4fe428-42da-4ee7-9687-960a6bd75ac8', '34dcb90c-3d1c-4bb3-8bc6-f609af3bae70', '1bc127d9-034b-471c-ad27-7d614555a50d'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:22:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:22:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:22:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.121s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:32 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:22:32 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Deleted volume successfully.
Sep 16 11:22:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-41b5737f-0d98-473e-a409-2fe9ea132cd6 tempest-AttachVolumeNegativeTest-986806239 None] Lock "cinder-1ab289b4-6387-4684-a9c1-87e1781ebc11-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:22:42 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=28,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=12 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:22:43 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=29,cinder:UPDATE=50,cinder:INSERT=8,cinder:DELETE=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:22:45 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Flow 'volume_create_manager' (f17861ae-bb41-463e-8557-ce1c33c6863c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa27c7d-deb4-4791-a4e0-6a590c998e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa27c7d-deb4-4791-a4e0-6a590c998e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1917846136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88cccef-36fc-4d9f-b797-4f90680bdb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f68006c70c4c1ca3ea4b773680aeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:22:46Z,use_quota=True,user_id='c1dfb6ce0ac947bcbd9ef87c7aebcbc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cec6732-8400-41db-b7ec-0449debb79aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cec6732-8400-41db-b7ec-0449debb79aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40903484-bb5f-4b5f-b47d-8a97f00f3927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40903484-bb5f-4b5f-b47d-8a97f00f3927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd88cccef-36fc-4d9f-b797-4f90680bdb66', 'volume_name': 'volume-d88cccef-36fc-4d9f-b797-4f90680bdb66', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ed24be-ab15-4be3-99e8-3c7dbcab2584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ed24be-ab15-4be3-99e8-3c7dbcab2584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0143f998-ce0f-47d8-bf45-950334437ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:45 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Volume d88cccef-36fc-4d9f-b797-4f90680bdb66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d88cccef-36fc-4d9f-b797-4f90680bdb66', 'volume_size': 1}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1917846136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88cccef-36fc-4d9f-b797-4f90680bdb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f68006c70c4c1ca3ea4b773680aeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:22:46Z,use_quota=True,user_id='c1dfb6ce0ac947bcbd9ef87c7aebcbc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Creating volume d88cccef-36fc-4d9f-b797-4f90680bdb66 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:22:46 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d88cccef-36fc-4d9f-b797-4f90680bdb66 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:46 devstack quobyte-client[83411]: System call of process 91987 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:22:46 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=27, name=volume-d88cccef-36fc-4d9f-b797-4f90680bdb66, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d88cccef-36fc-4d9f-b797-4f90680bdb66 1073741824" returned: 0 in 0.466s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d88cccef-36fc-4d9f-b797-4f90680bdb66 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d88cccef-36fc-4d9f-b797-4f90680bdb66" returned: 0 in 0.138s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] <== create_volume: return (675ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0143f998-ce0f-47d8-bf45-950334437ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d88cccef-36fc-4d9f-b797-4f90680bdb66', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d75abfc-a514-4b43-a46c-610256f93152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:46 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Volume volume-d88cccef-36fc-4d9f-b797-4f90680bdb66 (d88cccef-36fc-4d9f-b797-4f90680bdb66): created successfully
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d75abfc-a514-4b43-a46c-610256f93152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Flow 'volume_create_manager' (f17861ae-bb41-463e-8557-ce1c33c6863c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:22:47 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fc7252be-9b69-49db-b06a-2f4c12c9b500 tempest-AttachVolumeTestJSON-648416907 None] Created volume successfully.
Sep 16 11:22:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-8cc5ed74-569f-412e-a6c5-5746ff0a6e4b req-2f147e8b-f661-4d51-aa1c-89171a3a13ad tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-8cc5ed74-569f-412e-a6c5-5746ff0a6e4b req-2f147e8b-f661-4d51-aa1c-89171a3a13ad tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:52 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a893ddf1-13e1-467e-8c81-f4964c3a328d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:22:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-8cc5ed74-569f-412e-a6c5-5746ff0a6e4b req-2f147e8b-f661-4d51-aa1c-89171a3a13ad tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d88cccef-36fc-4d9f-b797-4f90680bdb66 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-8cc5ed74-569f-412e-a6c5-5746ff0a6e4b req-2f147e8b-f661-4d51-aa1c-89171a3a13ad tempest-AttachVolumeTestJSON-648416907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d88cccef-36fc-4d9f-b797-4f90680bdb66" returned: 0 in 0.491s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-8cc5ed74-569f-412e-a6c5-5746ff0a6e4b req-2f147e8b-f661-4d51-aa1c-89171a3a13ad tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.557s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-8cc5ed74-569f-412e-a6c5-5746ff0a6e4b req-2f147e8b-f661-4d51-aa1c-89171a3a13ad tempest-AttachVolumeTestJSON-648416907 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-d88cccef-36fc-4d9f-b797-4f90680bdb66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38c29b34-c765-43c0-9699-7d17f60395ae', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:22:52 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-8cc5ed74-569f-412e-a6c5-5746ff0a6e4b req-2f147e8b-f661-4d51-aa1c-89171a3a13ad tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:53 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Flow 'volume_create_manager' (be7bcdc7-3209-4c08-8300-8cee13e2e17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8997e2-5ae5-49ef-8a08-245c4b7351a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8997e2-5ae5-49ef-8a08-245c4b7351a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1152086796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa9f9d0-c857-47c4-ba20-15f3e401bfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a3cca9e0046e48e53d37eb1f21a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:22:53Z,use_quota=True,user_id='32b5cdecbbc64be68ff95ec34d5b4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07648cec-9454-4961-ab11-b21a0e6b4f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07648cec-9454-4961-ab11-b21a0e6b4f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb8f468-0eb3-47e7-bffe-e82a88e3a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb8f468-0eb3-47e7-bffe-e82a88e3a277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa9f9d0-c857-47c4-ba20-15f3e401bfa8', 'volume_name': 'volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e46c8c-d77c-48cb-a5e1-3ce0ecaa4855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e46c8c-d77c-48cb-a5e1-3ce0ecaa4855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f3b976-d702-49ed-920d-44454cdd360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:53 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Volume afa9f9d0-c857-47c4-ba20-15f3e401bfa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8', 'volume_size': 1}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1152086796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa9f9d0-c857-47c4-ba20-15f3e401bfa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce4a3cca9e0046e48e53d37eb1f21a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:22:53Z,use_quota=True,user_id='32b5cdecbbc64be68ff95ec34d5b4f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Creating volume afa9f9d0-c857-47c4-ba20-15f3e401bfa8 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:22:53 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:53 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=28, name=volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:22:53 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-8cc5ed74-569f-412e-a6c5-5746ff0a6e4b req-2f147e8b-f661-4d51-aa1c-89171a3a13ad tempest-AttachVolumeTestJSON-648416907 None] attachment_update completed successfully.
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 1073741824" returned: 0 in 0.402s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" returned: 0 in 0.095s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] <== create_volume: return (538ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.549s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f3b976-d702-49ed-920d-44454cdd360a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033d0344-281f-4cdb-8bae-6a42a892e27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:22:53 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Volume volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 (afa9f9d0-c857-47c4-ba20-15f3e401bfa8): created successfully
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033d0344-281f-4cdb-8bae-6a42a892e27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:22:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Flow 'volume_create_manager' (be7bcdc7-3209-4c08-8300-8cee13e2e17c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:22:53 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-78e74294-4b23-4452-bab5-7f61a51cf08f tempest-VolumesActionsTest-1063751593 None] Created volume successfully.
Sep 16 11:22:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a4799afa-0a5e-424c-874a-692e40cada17 tempest-BackendsCapabilitiesAdminTestsJSON-1421344798 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144706726074, 'free_capacity_gb': 924.9144706726074, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83386) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 16 11:22:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e111fbd7-43d4-438f-b135-1ce54f6827e9 tempest-BackendsCapabilitiesAdminTestsJSON-1421344798 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144706726074, 'free_capacity_gb': 924.9144706726074, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83386) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 16 11:23:03 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:23:03 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=6,cinder:DELETE=2,cinder:SELECT=7 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:23:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-98ff4a9c-60d9-49e4-8941-7beff2456882 tempest-VolumesActionsTest-1063751593 None] Acquiring lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" by "attach_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:23:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-98ff4a9c-60d9-49e4-8941-7beff2456882 tempest-VolumesActionsTest-1063751593 None] Lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" acquired by "attach_volume" :: waited 0.055s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:23:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-98ff4a9c-60d9-49e4-8941-7beff2456882 tempest-VolumesActionsTest-1063751593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:23:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-98ff4a9c-60d9-49e4-8941-7beff2456882 tempest-VolumesActionsTest-1063751593 None] Attaching volume afa9f9d0-c857-47c4-ba20-15f3e401bfa8 to instance 20a5ea72-534e-45db-8dd4-5e923a164421 at mountpoint /dev/vdb on host None.
Sep 16 11:23:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-98ff4a9c-60d9-49e4-8941-7beff2456882 tempest-VolumesActionsTest-1063751593 None] Attach volume completed successfully.
Sep 16 11:23:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-98ff4a9c-60d9-49e4-8941-7beff2456882 tempest-VolumesActionsTest-1063751593 None] Lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" released by "attach_volume" :: held 0.737s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:23:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:23:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:23:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:23:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:23:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:23:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.074s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:23:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:23:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d857ce7a-62e6-4bd5-9318-90e558a0758a tempest-VolumesActionsTest-1063751593 None] Acquiring lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8-detach_volume" by "detach_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:23:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d857ce7a-62e6-4bd5-9318-90e558a0758a tempest-VolumesActionsTest-1063751593 None] Lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8-detach_volume" acquired by "detach_volume" :: waited 0.410s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:23:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d857ce7a-62e6-4bd5-9318-90e558a0758a tempest-VolumesActionsTest-1063751593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:23:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d857ce7a-62e6-4bd5-9318-90e558a0758a tempest-VolumesActionsTest-1063751593 None] Detaching volume afa9f9d0-c857-47c4-ba20-15f3e401bfa8 from instance 20a5ea72-534e-45db-8dd4-5e923a164421.
Sep 16 11:23:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d857ce7a-62e6-4bd5-9318-90e558a0758a tempest-VolumesActionsTest-1063751593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:23:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 1.707s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:23:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:23:28 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d857ce7a-62e6-4bd5-9318-90e558a0758a tempest-VolumesActionsTest-1063751593 None] Detach volume completed successfully.
Sep 16 11:23:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d857ce7a-62e6-4bd5-9318-90e558a0758a tempest-VolumesActionsTest-1063751593 None] Lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8-detach_volume" released by "detach_volume" :: held 1.512s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:23:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:INSERT=2,cinder:SELECT=6,cinder:UPDATE=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:23:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:23:41 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Flow 'volume_create_manager' (bb500b3b-02f3-4653-94d4-d7391832e154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b500c52-93d9-4559-a4b6-63c20ad0213f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b500c52-93d9-4559-a4b6-63c20ad0213f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1351000074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fcc327180e468da5981fc4fa130073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:23:41Z,use_quota=True,user_id='df78f14072924c1eac8a4dcf842b1941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5993fb-431c-481b-8a13-b674af264756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5993fb-431c-481b-8a13-b674af264756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d90934d-0498-4f59-929f-d2d7f0add8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d90934d-0498-4f59-929f-d2d7f0add8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac', 'volume_name': 'volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955929c4-4ea2-416d-8be6-72f7f0ea49cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955929c4-4ea2-416d-8be6-72f7f0ea49cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5100a8-2b48-4da4-a5df-cb80f61aa6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:41 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Volume 4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac', 'volume_size': 1}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1351000074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6fcc327180e468da5981fc4fa130073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:23:41Z,use_quota=True,user_id='df78f14072924c1eac8a4dcf842b1941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Creating volume 4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:23:41 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:23:41 devstack quobyte-client[83411]: System call of process 93152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:23:41 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=29, name=volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac 1073741824" returned: 0 in 0.504s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:23:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:23:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac" returned: 0 in 0.183s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:23:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] <== create_volume: return (823ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:23:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:23:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5100a8-2b48-4da4-a5df-cb80f61aa6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a4eac2-f48d-4434-8287-99dd1363922f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:42 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Volume volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac (4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac): created successfully
Sep 16 11:23:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a4eac2-f48d-4434-8287-99dd1363922f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Flow 'volume_create_manager' (bb500b3b-02f3-4653-94d4-d7391832e154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:23:42 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e5fc4fbf-7ec5-47ee-be90-0113bb76da55 tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Created volume successfully.
Sep 16 11:23:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Acquiring lock "cinder-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:23:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Lock "cinder-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:23:45 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:23:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Acquiring lock "cinder-quobyte-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:23:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Lock "cinder-quobyte-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac" acquired by "delete_volume" :: waited 0.017s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:23:45 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e7fe19-267b-443b-98c2-8490fe550fd8]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:23:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac" returned: 0 in 0.624s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac" returned: 0 in 0.093s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Lock "cinder-quobyte-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac" released by "delete_volume" :: held 0.888s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Created reservations ['c3887c3e-349b-43fa-8540-f3fc4d5f00b5', '0b6a5ee2-3a53-4a21-bb7e-b53d0f021082', '57049cb7-6234-418d-a12c-4de53c9a7d15', 'e3e2be8f-f738-487b-b73b-275ee0705b69'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.133s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:23:46 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:23:47 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Deleted volume successfully.
Sep 16 11:23:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c14943d9-efb6-4feb-931b-ac0fdacac4fa tempest-VolumeQuotasNegativeTestJSON-1911352687 None] Lock "cinder-4b81b8bc-5e08-4da2-81f5-8993f3f5b8ac-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:23:56 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:INSERT=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:23:57 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=17,cinder:DELETE=2,cinder:SELECT=6 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:23:58 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:23:58 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:23:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Flow 'volume_create_manager' (89208b30-9940-4461-920e-dd4e082ca97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:23:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74578ef2-00b6-43f9-abd0-b08d3c16a907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74578ef2-00b6-43f9-abd0-b08d3c16a907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2033716451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce10751-5c5c-4686-8158-a6f35ad11b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12ba3c4b6ef475187c93a6888e2e173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:23:59Z,use_quota=True,user_id='5083f704e5684f508be403b16b9d95db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6b4d0c5-ca3b-40d0-8bc8-51955b519cd4),volume_type_id=d6b4d0c5-ca3b-40d0-8bc8-51955b519cd4)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdde6f8-2eec-483e-92e4-d40ec5df3f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdde6f8-2eec-483e-92e4-d40ec5df3f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aad7107-4e71-4659-b696-6f2051006ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aad7107-4e71-4659-b696-6f2051006ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce10751-5c5c-4686-8158-a6f35ad11b07', 'volume_name': 'volume-5ce10751-5c5c-4686-8158-a6f35ad11b07', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23867b1b-c680-48a3-ae01-ac799abad9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23867b1b-c680-48a3-ae01-ac799abad9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43db3493-f4be-4349-a0a1-9cacdf4a0ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:59 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Volume 5ce10751-5c5c-4686-8158-a6f35ad11b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce10751-5c5c-4686-8158-a6f35ad11b07', 'volume_size': 1}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2033716451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce10751-5c5c-4686-8158-a6f35ad11b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b12ba3c4b6ef475187c93a6888e2e173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:23:59Z,use_quota=True,user_id='5083f704e5684f508be403b16b9d95db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6b4d0c5-ca3b-40d0-8bc8-51955b519cd4),volume_type_id=d6b4d0c5-ca3b-40d0-8bc8-51955b519cd4)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Creating volume 5ce10751-5c5c-4686-8158-a6f35ad11b07 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:23:59 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5ce10751-5c5c-4686-8158-a6f35ad11b07 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:23:59 devstack quobyte-client[83411]: System call of process 93191 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:23:59 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=30, name=volume-5ce10751-5c5c-4686-8158-a6f35ad11b07, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5ce10751-5c5c-4686-8158-a6f35ad11b07 1073741824" returned: 0 in 0.376s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5ce10751-5c5c-4686-8158-a6f35ad11b07 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5ce10751-5c5c-4686-8158-a6f35ad11b07" returned: 0 in 0.117s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] <== create_volume: return (556ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.569s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43db3493-f4be-4349-a0a1-9cacdf4a0ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce10751-5c5c-4686-8158-a6f35ad11b07', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ec0166-f4bc-42d2-a365-b400dc06aaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:23:59 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Volume volume-5ce10751-5c5c-4686-8158-a6f35ad11b07 (5ce10751-5c5c-4686-8158-a6f35ad11b07): created successfully
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ec0166-f4bc-42d2-a365-b400dc06aaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:23:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Flow 'volume_create_manager' (89208b30-9940-4461-920e-dd4e082ca97d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:24:00 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-01f2f953-5931-43ea-9226-98863906540d tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Created volume successfully.
Sep 16 11:24:01 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-be9e3523-97ec-4096-96f1-d82e1d412f6f tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:24:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-be9e3523-97ec-4096-96f1-d82e1d412f6f tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:24:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-be9e3523-97ec-4096-96f1-d82e1d412f6f tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:24:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-be9e3523-97ec-4096-96f1-d82e1d412f6f tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:24:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-be9e3523-97ec-4096-96f1-d82e1d412f6f tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:24:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-be9e3523-97ec-4096-96f1-d82e1d412f6f tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:24:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-be9e3523-97ec-4096-96f1-d82e1d412f6f tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:24:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-be9e3523-97ec-4096-96f1-d82e1d412f6f tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.155s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:24:01 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-be9e3523-97ec-4096-96f1-d82e1d412f6f tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:24:02 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-be9e3523-97ec-4096-96f1-d82e1d412f6f tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Retype volume completed successfully.
Sep 16 11:24:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Acquiring lock "cinder-5ce10751-5c5c-4686-8158-a6f35ad11b07-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:24:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "cinder-5ce10751-5c5c-4686-8158-a6f35ad11b07-delete_volume" acquired by "delete_volume" :: waited 0.284s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:24:04 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:24:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Acquiring lock "cinder-quobyte-5ce10751-5c5c-4686-8158-a6f35ad11b07" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:24:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "cinder-quobyte-5ce10751-5c5c-4686-8158-a6f35ad11b07" acquired by "delete_volume" :: waited 0.037s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:24:05 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d66aa78-06ed-456d-aebf-244dd67a22e9]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:24:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5ce10751-5c5c-4686-8158-a6f35ad11b07 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:24:06 devstack quobyte-client[83411]: System call of process 93259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:24:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5ce10751-5c5c-4686-8158-a6f35ad11b07" returned: 0 in 1.373s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:24:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5ce10751-5c5c-4686-8158-a6f35ad11b07 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:24:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5ce10751-5c5c-4686-8158-a6f35ad11b07" returned: 0 in 0.158s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:24:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "cinder-quobyte-5ce10751-5c5c-4686-8158-a6f35ad11b07" released by "delete_volume" :: held 1.881s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:24:07 devstack cinder-volume[83386]: WARNING cinder.quota [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:24:07 devstack cinder-volume[83386]: WARNING cinder.quota [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:24:07 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Created reservations ['4c592aac-bb86-4a88-a963-372a0605e5bb', '93c85eac-2073-46dc-b099-9aa80a751134', 'e4275ce4-0280-4c7d-b4e2-a82ecb791ab2', '604f7be4-6031-44c0-9078-028372058777'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:24:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:24:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:24:07 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:24:07 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:24:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:24:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:24:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.170s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:24:08 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:24:08 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Deleted volume successfully.
Sep 16 11:24:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f35e1157-3336-4b72-9c25-9fb2537717b3 tempest-VolumeRetypeWithoutMigrationTest-1993459321 None] Lock "cinder-5ce10751-5c5c-4686-8158-a6f35ad11b07-delete_volume" released by "delete_volume" :: held 4.970s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:24:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d60bb49a-d6b1-470f-8bf7-6679cf29b497 tempest-VolumesActionsTest-1063751593 None] Acquiring lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" by "attach_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:24:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d60bb49a-d6b1-470f-8bf7-6679cf29b497 tempest-VolumesActionsTest-1063751593 None] Lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" acquired by "attach_volume" :: waited 0.027s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:24:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d60bb49a-d6b1-470f-8bf7-6679cf29b497 tempest-VolumesActionsTest-1063751593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:24:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d60bb49a-d6b1-470f-8bf7-6679cf29b497 tempest-VolumesActionsTest-1063751593 None] Attaching volume afa9f9d0-c857-47c4-ba20-15f3e401bfa8 to instance 6f588827-adca-4a1f-807f-fa511a6a8d8d at mountpoint /dev/vdb on host None.
Sep 16 11:24:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d60bb49a-d6b1-470f-8bf7-6679cf29b497 tempest-VolumesActionsTest-1063751593 None] Attach volume completed successfully.
Sep 16 11:24:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d60bb49a-d6b1-470f-8bf7-6679cf29b497 tempest-VolumesActionsTest-1063751593 None] Lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" released by "attach_volume" :: held 0.331s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:24:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb67f37d-f83a-4e4d-ae56-6107b1130c6d tempest-VolumesActionsTest-1063751593 None] Acquiring lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8-detach_volume" by "detach_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:24:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb67f37d-f83a-4e4d-ae56-6107b1130c6d tempest-VolumesActionsTest-1063751593 None] Lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:24:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-cb67f37d-f83a-4e4d-ae56-6107b1130c6d tempest-VolumesActionsTest-1063751593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:24:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-cb67f37d-f83a-4e4d-ae56-6107b1130c6d tempest-VolumesActionsTest-1063751593 None] Detaching volume afa9f9d0-c857-47c4-ba20-15f3e401bfa8 from instance 6f588827-adca-4a1f-807f-fa511a6a8d8d.
Sep 16 11:24:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-cb67f37d-f83a-4e4d-ae56-6107b1130c6d tempest-VolumesActionsTest-1063751593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:24:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-cb67f37d-f83a-4e4d-ae56-6107b1130c6d tempest-VolumesActionsTest-1063751593 None] Detach volume completed successfully.
Sep 16 11:24:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb67f37d-f83a-4e4d-ae56-6107b1130c6d tempest-VolumesActionsTest-1063751593 None] Lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:24:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:24:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:24:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:24:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:24:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:24:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:24:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:24:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.217s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:24:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:24:29 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:24:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:24:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:24:29 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[93826391-85af-4a19-8720-1d40e79af98d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:24:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:24:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" returned: 0 in 0.641s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:24:29 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c95ff08-d3e0-4899-a990-580cb40ec5c6]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:24:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:24:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" returned: 0 in 0.601s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:24:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.b072f391-e9e9-4694-a67c-510fda45e5c9szntkk9a.img {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:24:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:24:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=24,cinder:UPDATE=15,cinder:INSERT=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:24:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.b072f391-e9e9-4694-a67c-510fda45e5c9szntkk9a.img" returned: 0 in 8.909s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:24:39 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[12307e5d-44a7-4177-b424-33029adb289d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:24:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:24:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" returned: 0 in 0.939s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:24:40 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Image conversion details: src /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8, size 1024.00 MB, duration 8.93 sec, destination /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.b072f391-e9e9-4694-a67c-510fda45e5c9szntkk9a.img {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:24:40 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Converted 1024.00 MB image at 114.73 MB/s
Sep 16 11:24:40 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] b072f391-e9e9-4694-a67c-510fda45e5c9 was raw, no need to convert to raw {{(pid=83386) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 16 11:24:50 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:25:04 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-adb55796-d3c2-4012-a741-0cb666859e5e req-3217fecb-18cf-4635-bb10-6408ff97699d tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:25:04 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-adb55796-d3c2-4012-a741-0cb666859e5e req-3217fecb-18cf-4635-bb10-6408ff97699d tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:25:04 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-adb55796-d3c2-4012-a741-0cb666859e5e req-3217fecb-18cf-4635-bb10-6408ff97699d tempest-AttachVolumeTestJSON-648416907 None] Terminate volume connection completed successfully.
Sep 16 11:25:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-adb55796-d3c2-4012-a741-0cb666859e5e req-3217fecb-18cf-4635-bb10-6408ff97699d tempest-AttachVolumeTestJSON-648416907 None] Deleting attachment 38c29b34-c765-43c0-9699-7d17f60395ae. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:25:14 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:25:14 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:25:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:25:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:25:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:25:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:25:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:25:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:25:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:25:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.425s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:25:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:25:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 76.895s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:25:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Uploaded volume to glance image-id: b072f391-e9e9-4694-a67c-510fda45e5c9. {{(pid=83386) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 16 11:25:47 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e52a9d95-1e8c-41af-93ce-c55cd134da39 tempest-VolumesActionsTest-1063751593 None] Copy volume to image completed successfully.
Sep 16 11:25:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:25:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:25:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:25:51 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02be770-8357-4072-89f3-1c3ae8dcb557]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:25:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:25:52 devstack quobyte-client[83411]: System call of process 93981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:25:52 devstack quobyte-client[83411]: System call of process 93981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:25:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" returned: 0 in 0.993s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:25:52 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[055419c5-970b-4d50-9bf9-cf00bbfc3253]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:25:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:25:53 devstack quobyte-client[83411]: System call of process 93989 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:25:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" returned: 0 in 0.842s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:25:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:01 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:26:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img" returned: 0 in 11.228s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:04 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb391a6-899c-42d0-a0eb-0f9cd1c170ce]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:26:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:05 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (5228c274-b47a-425f-8ca9-1f03df09c47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5922e499-795c-4c82-a1ee-dc52311e0083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5922e499-795c-4c82-a1ee-dc52311e0083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1526309996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920610f2-512d-427e-9b56-07ed7910647b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:05Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ebd7c4-d17b-44b3-a9c1-bcd4ce43013b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ebd7c4-d17b-44b3-a9c1-bcd4ce43013b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46e3ffe-be97-4798-966b-b7e83ea6c85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46e3ffe-be97-4798-966b-b7e83ea6c85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920610f2-512d-427e-9b56-07ed7910647b', 'volume_name': 'volume-920610f2-512d-427e-9b56-07ed7910647b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3961b90d-c92b-42e9-ab74-7ddcae35bf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3961b90d-c92b-42e9-ab74-7ddcae35bf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bab21d4-9ad6-4f86-b8c3-7eb7576a94ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:05 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Volume 920610f2-512d-427e-9b56-07ed7910647b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920610f2-512d-427e-9b56-07ed7910647b', 'volume_size': 1}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" returned: 0 in 0.814s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Image conversion details: src /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8, size 1024.00 MB, duration 11.24 sec, destination /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:26:05 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Converted 1024.00 MB image at 91.14 MB/s
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] 4ff46d2f-5b02-4902-8994-be580d54f3b2 was raw, converting to qcow2 {{(pid=83386) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccdfa2b-e072-46dd-9672-b9ae1a5562f6]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:26:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img" returned: 0 in 0.796s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img" returned: 1 in 0.508s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:26:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img /opt/stack/data/cinder/conversion/vol_upload_rxgof08j {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img /opt/stack/data/cinder/conversion/vol_upload_rxgof08j" returned: 0 in 0.161s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:07 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Image conversion details: src /opt/stack/data/cinder/conversion/afa9f9d0-c857-47c4-ba20-15f3e401bfa8.temp_image.4ff46d2f-5b02-4902-8994-be580d54f3b2my1teb67.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_rxgof08j {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:26:07 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 16 11:26:07 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6d6a5-db57-4963-9319-3046770c6a88]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:26:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rxgof08j {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rxgof08j" returned: 0 in 0.455s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 18.159s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Uploaded volume to glance image-id: 4ff46d2f-5b02-4902-8994-be580d54f3b2. {{(pid=83386) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.203s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1526309996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920610f2-512d-427e-9b56-07ed7910647b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:05Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Creating volume 920610f2-512d-427e-9b56-07ed7910647b {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:26:09 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:26:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-920610f2-512d-427e-9b56-07ed7910647b 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:09 devstack quobyte-client[83411]: System call of process 94033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:26:10 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=31, name=volume-920610f2-512d-427e-9b56-07ed7910647b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:26:10 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e06f158f-1781-4359-89e9-2083527e1762 tempest-VolumesActionsTest-1063751593 None] Copy volume to image completed successfully.
Sep 16 11:26:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-920610f2-512d-427e-9b56-07ed7910647b 1073741824" returned: 0 in 1.116s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-920610f2-512d-427e-9b56-07ed7910647b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-920610f2-512d-427e-9b56-07ed7910647b" returned: 0 in 0.264s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] <== create_volume: return (1443ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:26:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bab21d4-9ad6-4f86-b8c3-7eb7576a94ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920610f2-512d-427e-9b56-07ed7910647b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afba8430-7c37-41fc-9ced-794863dc5d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:11 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Volume volume-920610f2-512d-427e-9b56-07ed7910647b (920610f2-512d-427e-9b56-07ed7910647b): created successfully
Sep 16 11:26:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afba8430-7c37-41fc-9ced-794863dc5d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (5228c274-b47a-425f-8ca9-1f03df09c47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:11 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ed3ceb09-6d83-4d96-8681-3bc2cf08e3de tempest-VolumesActionsTest-1997144303 None] Created volume successfully.
Sep 16 11:26:12 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-450e16fe-8d4e-48d2-a6a9-c726e0875977 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "cinder-920610f2-512d-427e-9b56-07ed7910647b" by "attach_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:12 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Acquiring lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:12 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-450e16fe-8d4e-48d2-a6a9-c726e0875977 tempest-VolumesActionsTest-1997144303 None] Lock "cinder-920610f2-512d-427e-9b56-07ed7910647b" acquired by "attach_volume" :: waited 0.089s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:12 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:12 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:12 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Acquiring lock "cinder-quobyte-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:12 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Lock "cinder-quobyte-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" acquired by "delete_volume" :: waited 0.037s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:12 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fd3911-50f4-4a97-902f-43f7ecebb8d8]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:26:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:12 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-450e16fe-8d4e-48d2-a6a9-c726e0875977 tempest-VolumesActionsTest-1997144303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:12 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-450e16fe-8d4e-48d2-a6a9-c726e0875977 tempest-VolumesActionsTest-1997144303 None] Attaching volume 920610f2-512d-427e-9b56-07ed7910647b to instance 0b0ac7f3-7163-4d2d-9b1a-60a610e49358 at mountpoint /dev/vdb on host None.
Sep 16 11:26:13 devstack quobyte-client[83411]: System call of process 94039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" returned: 0 in 0.751s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:13 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-450e16fe-8d4e-48d2-a6a9-c726e0875977 tempest-VolumesActionsTest-1997144303 None] Attach volume completed successfully.
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-450e16fe-8d4e-48d2-a6a9-c726e0875977 tempest-VolumesActionsTest-1997144303 None] Lock "cinder-920610f2-512d-427e-9b56-07ed7910647b" released by "attach_volume" :: held 1.325s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" returned: 0 in 0.358s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Lock "cinder-quobyte-afa9f9d0-c857-47c4-ba20-15f3e401bfa8" released by "delete_volume" :: held 1.197s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Created reservations ['0985bdbb-26b0-459c-8635-73d2c2d441f3', '39d5c34d-8960-466b-9fa4-02fd1a6fe599', '8004e94f-7445-407f-be68-e91a3fd183b3', 'cba8d086-8d96-4bd5-8db8-81a5578d781e'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.147s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:14 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:26:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Deleted volume successfully.
Sep 16 11:26:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-86d35e4d-ee69-4c4a-8534-3c37d78ee78b tempest-VolumesActionsTest-1063751593 None] Lock "cinder-afa9f9d0-c857-47c4-ba20-15f3e401bfa8-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8eb4e0ef-8e6b-421c-831c-0b4996779165 tempest-VolumesActionsTest-2051316274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:15 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8eb4e0ef-8e6b-421c-831c-0b4996779165 tempest-VolumesActionsTest-2051316274 None] Terminate volume connection completed successfully.
Sep 16 11:26:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8eb4e0ef-8e6b-421c-831c-0b4996779165 tempest-VolumesActionsTest-2051316274 None] Acquiring lock "cinder-920610f2-512d-427e-9b56-07ed7910647b-detach_volume" by "detach_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8eb4e0ef-8e6b-421c-831c-0b4996779165 tempest-VolumesActionsTest-2051316274 None] Lock "cinder-920610f2-512d-427e-9b56-07ed7910647b-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8eb4e0ef-8e6b-421c-831c-0b4996779165 tempest-VolumesActionsTest-2051316274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:15 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8eb4e0ef-8e6b-421c-831c-0b4996779165 tempest-VolumesActionsTest-2051316274 None] Detaching volume 920610f2-512d-427e-9b56-07ed7910647b from instance 0b0ac7f3-7163-4d2d-9b1a-60a610e49358.
Sep 16 11:26:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8eb4e0ef-8e6b-421c-831c-0b4996779165 tempest-VolumesActionsTest-2051316274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:16 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8eb4e0ef-8e6b-421c-831c-0b4996779165 tempest-VolumesActionsTest-2051316274 None] Detach volume completed successfully.
Sep 16 11:26:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8eb4e0ef-8e6b-421c-831c-0b4996779165 tempest-VolumesActionsTest-2051316274 None] Lock "cinder-920610f2-512d-427e-9b56-07ed7910647b-detach_volume" released by "detach_volume" :: held 0.253s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-11916e62-b955-4cee-b8be-01545eaf95ab tempest-VolumesActionsTest-1997144303 None] Acquiring lock "cinder-920610f2-512d-427e-9b56-07ed7910647b-detach_volume" by "detach_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-11916e62-b955-4cee-b8be-01545eaf95ab tempest-VolumesActionsTest-1997144303 None] Lock "cinder-920610f2-512d-427e-9b56-07ed7910647b-detach_volume" acquired by "detach_volume" :: waited 0.064s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:16 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-11916e62-b955-4cee-b8be-01545eaf95ab tempest-VolumesActionsTest-1997144303 None] Volume detach called, but volume not attached.
Sep 16 11:26:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-11916e62-b955-4cee-b8be-01545eaf95ab tempest-VolumesActionsTest-1997144303 None] Lock "cinder-920610f2-512d-427e-9b56-07ed7910647b-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Acquiring lock "cinder-920610f2-512d-427e-9b56-07ed7910647b-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Lock "cinder-920610f2-512d-427e-9b56-07ed7910647b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Acquiring lock "cinder-quobyte-920610f2-512d-427e-9b56-07ed7910647b" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Lock "cinder-quobyte-920610f2-512d-427e-9b56-07ed7910647b" acquired by "delete_volume" :: waited 0.035s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:18 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c638e3-c114-462b-9167-046969d6c99e]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:26:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-920610f2-512d-427e-9b56-07ed7910647b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:19 devstack quobyte-client[83411]: System call of process 94049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:26:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-920610f2-512d-427e-9b56-07ed7910647b" returned: 0 in 1.084s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-920610f2-512d-427e-9b56-07ed7910647b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-920610f2-512d-427e-9b56-07ed7910647b" returned: 0 in 0.198s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:19 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Lock "cinder-quobyte-920610f2-512d-427e-9b56-07ed7910647b" released by "delete_volume" :: held 1.644s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:20 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Created reservations ['963e8e08-0b92-4aac-8c3f-763d6794660a', 'd3c3d2d5-5946-44d3-82c4-db6c8b820a1d', '36a7ff20-a9b1-408f-aedb-b1aa8b1dd412', 'ca7adc16-f5b7-4111-9a08-07bb9e4118a8'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:26:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.185s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:20 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:26:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Deleted volume successfully.
Sep 16 11:26:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b7c98c41-c1a4-42cc-844b-5a3eee526e2b tempest-VolumesActionsTest-1997144303 None] Lock "cinder-920610f2-512d-427e-9b56-07ed7910647b-delete_volume" released by "delete_volume" :: held 3.572s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:26:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.115s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:26:30 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:30 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (d3e99e0b-d4e6-4fa1-b1a1-c0e77a5a125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4787b1f1-13cb-4f8d-8621-c05dc59dcb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4787b1f1-13cb-4f8d-8621-c05dc59dcb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-804529774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99167ad-e8a4-42b6-8c7a-630923c484b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:31Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedfcb83-371e-45ad-89cb-33ca20bc5b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedfcb83-371e-45ad-89cb-33ca20bc5b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5ba66d-e7b2-447a-a05a-75a11e727c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5ba66d-e7b2-447a-a05a-75a11e727c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99167ad-e8a4-42b6-8c7a-630923c484b5', 'volume_name': 'volume-f99167ad-e8a4-42b6-8c7a-630923c484b5', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17666c1e-2e3e-438e-abbc-266ee18f2372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17666c1e-2e3e-438e-abbc-266ee18f2372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcf2078-7feb-4eb6-882a-3e06965bf970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:31 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Volume f99167ad-e8a4-42b6-8c7a-630923c484b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99167ad-e8a4-42b6-8c7a-630923c484b5', 'volume_size': 1}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-804529774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99167ad-e8a4-42b6-8c7a-630923c484b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:31Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Creating volume f99167ad-e8a4-42b6-8c7a-630923c484b5 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:26:31 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f99167ad-e8a4-42b6-8c7a-630923c484b5 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:31 devstack quobyte-client[83411]: System call of process 94099 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:26:31 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=32, name=volume-f99167ad-e8a4-42b6-8c7a-630923c484b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f99167ad-e8a4-42b6-8c7a-630923c484b5 1073741824" returned: 0 in 0.431s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f99167ad-e8a4-42b6-8c7a-630923c484b5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f99167ad-e8a4-42b6-8c7a-630923c484b5" returned: 0 in 0.372s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] <== create_volume: return (896ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:32 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Flow 'volume_create_manager' (60c8c2a2-3268-48d4-9318-2f6657d5018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6d07dd-a7ef-4381-b848-d67f482a09f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcf2078-7feb-4eb6-882a-3e06965bf970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99167ad-e8a4-42b6-8c7a-630923c484b5', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b8e414-956e-4cec-b96d-cb9e6ee49862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6d07dd-a7ef-4381-b848-d67f482a09f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1202535441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207c0b8a-a938-440d-91ca-b1447a4f137a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234c443221df44b2aa73076d0333e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:32Z,use_quota=True,user_id='aeaa9196521f4282b3fc78b7e8d91d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7e1e39-c4cf-4752-bceb-6990b125e262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7e1e39-c4cf-4752-bceb-6990b125e262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543e8aae-09cd-4529-a381-d2b842bd487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543e8aae-09cd-4529-a381-d2b842bd487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207c0b8a-a938-440d-91ca-b1447a4f137a', 'volume_name': 'volume-207c0b8a-a938-440d-91ca-b1447a4f137a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b70169f-53d0-4990-abf5-2317b713ca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b70169f-53d0-4990-abf5-2317b713ca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcc472b-7e82-45ff-95ff-22f080fd08f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:32 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Volume 207c0b8a-a938-440d-91ca-b1447a4f137a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207c0b8a-a938-440d-91ca-b1447a4f137a', 'volume_size': 1}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1202535441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207c0b8a-a938-440d-91ca-b1447a4f137a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234c443221df44b2aa73076d0333e8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:32Z,use_quota=True,user_id='aeaa9196521f4282b3fc78b7e8d91d86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Creating volume 207c0b8a-a938-440d-91ca-b1447a4f137a {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:26:32 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-207c0b8a-a938-440d-91ca-b1447a4f137a 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:32 devstack quobyte-client[83411]: System call of process 94104 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:26:32 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=33, name=volume-207c0b8a-a938-440d-91ca-b1447a4f137a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:26:32 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Volume volume-f99167ad-e8a4-42b6-8c7a-630923c484b5 (f99167ad-e8a4-42b6-8c7a-630923c484b5): created successfully
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b8e414-956e-4cec-b96d-cb9e6ee49862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (d3e99e0b-d4e6-4fa1-b1a1-c0e77a5a125c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:32 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-bddc0677-62f7-4c62-a5be-ebcc3c7c4ed3 tempest-VolumesActionsTest-1997144303 None] Created volume successfully.
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-207c0b8a-a938-440d-91ca-b1447a4f137a 1073741824" returned: 0 in 0.497s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-207c0b8a-a938-440d-91ca-b1447a4f137a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-207c0b8a-a938-440d-91ca-b1447a4f137a" returned: 0 in 0.121s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] <== create_volume: return (666ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:26:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcc472b-7e82-45ff-95ff-22f080fd08f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207c0b8a-a938-440d-91ca-b1447a4f137a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1268f4c6-9f27-4830-a931-27e851f533e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:33 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Volume volume-207c0b8a-a938-440d-91ca-b1447a4f137a (207c0b8a-a938-440d-91ca-b1447a4f137a): created successfully
Sep 16 11:26:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1268f4c6-9f27-4830-a931-27e851f533e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Flow 'volume_create_manager' (60c8c2a2-3268-48d4-9318-2f6657d5018c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Acquiring lock "cinder-f99167ad-e8a4-42b6-8c7a-630923c484b5-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:33 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-6af3bc8e-3067-4cec-94bc-1af09d86da7b tempest-VolumesNegativeTest-2068338748 None] Created volume successfully.
Sep 16 11:26:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Lock "cinder-f99167ad-e8a4-42b6-8c7a-630923c484b5-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:33 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Acquiring lock "cinder-quobyte-f99167ad-e8a4-42b6-8c7a-630923c484b5" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Lock "cinder-quobyte-f99167ad-e8a4-42b6-8c7a-630923c484b5" acquired by "delete_volume" :: waited 0.019s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:33 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a530b1-7f38-4843-82b7-d7bf5d54a85c]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:26:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f99167ad-e8a4-42b6-8c7a-630923c484b5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:34 devstack quobyte-client[83411]: System call of process 94111 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:26:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f99167ad-e8a4-42b6-8c7a-630923c484b5" returned: 0 in 0.552s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f99167ad-e8a4-42b6-8c7a-630923c484b5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f99167ad-e8a4-42b6-8c7a-630923c484b5" returned: 0 in 0.145s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Lock "cinder-quobyte-f99167ad-e8a4-42b6-8c7a-630923c484b5" released by "delete_volume" :: held 0.909s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:34 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Created reservations ['ce6a4ad7-c77d-4dd7-8a2c-01c6a9ab7545', 'e115e10e-4209-48a3-a8ec-23e4b2ec859d', '9293c954-1713-430b-b76f-f13fa4b5a944', '4e852340-74aa-43a7-82e7-c48eb754e1ac'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:26:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.186s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:35 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:26:35 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Deleted volume successfully.
Sep 16 11:26:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3e976a6e-7feb-4e94-922e-7f8be8e4eebd tempest-VolumesActionsTest-2051316274 None] Lock "cinder-f99167ad-e8a4-42b6-8c7a-630923c484b5-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:36 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (c803851e-d6ba-4fcf-b350-8de39b66f3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc27c790-ad06-4e1d-9a03-f10dce2ee494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc27c790-ad06-4e1d-9a03-f10dce2ee494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-625492561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde80443-4f98-4533-af21-ae2627d742fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:36Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a4352d-bff1-4766-822f-b1e108579f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a4352d-bff1-4766-822f-b1e108579f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee556c1-7c0f-4d68-8ab5-7c3f71e24400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee556c1-7c0f-4d68-8ab5-7c3f71e24400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde80443-4f98-4533-af21-ae2627d742fc', 'volume_name': 'volume-dde80443-4f98-4533-af21-ae2627d742fc', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b50528-76ed-44f2-bee6-2f07aea8f8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b50528-76ed-44f2-bee6-2f07aea8f8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97adb64f-1c95-43f2-9213-9ccceab8ecbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:36 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Volume dde80443-4f98-4533-af21-ae2627d742fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde80443-4f98-4533-af21-ae2627d742fc', 'volume_size': 1}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-625492561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde80443-4f98-4533-af21-ae2627d742fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:36Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Creating volume dde80443-4f98-4533-af21-ae2627d742fc {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:26:36 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:26:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde80443-4f98-4533-af21-ae2627d742fc 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:37 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=34, name=volume-dde80443-4f98-4533-af21-ae2627d742fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:26:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde80443-4f98-4533-af21-ae2627d742fc 1073741824" returned: 0 in 0.413s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde80443-4f98-4533-af21-ae2627d742fc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde80443-4f98-4533-af21-ae2627d742fc" returned: 0 in 0.109s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] <== create_volume: return (647ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:26:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97adb64f-1c95-43f2-9213-9ccceab8ecbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde80443-4f98-4533-af21-ae2627d742fc', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c593eff-0f62-408a-b231-6e35f38f8302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:37 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Volume volume-dde80443-4f98-4533-af21-ae2627d742fc (dde80443-4f98-4533-af21-ae2627d742fc): created successfully
Sep 16 11:26:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c593eff-0f62-408a-b231-6e35f38f8302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (c803851e-d6ba-4fcf-b350-8de39b66f3ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-c9470ed8-229f-4fe4-a4b4-6b460aa65932 tempest-VolumesActionsTest-1997144303 None] Created volume successfully.
Sep 16 11:26:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Acquiring lock "cinder-dde80443-4f98-4533-af21-ae2627d742fc-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Lock "cinder-dde80443-4f98-4533-af21-ae2627d742fc-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:39 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Acquiring lock "cinder-quobyte-dde80443-4f98-4533-af21-ae2627d742fc" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Lock "cinder-quobyte-dde80443-4f98-4533-af21-ae2627d742fc" acquired by "delete_volume" :: waited 0.028s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:39 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14d64fe-372e-4434-9e89-9db7b623701a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:26:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde80443-4f98-4533-af21-ae2627d742fc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde80443-4f98-4533-af21-ae2627d742fc" returned: 0 in 0.449s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde80443-4f98-4533-af21-ae2627d742fc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde80443-4f98-4533-af21-ae2627d742fc" returned: 0 in 0.114s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:40 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Lock "cinder-quobyte-dde80443-4f98-4533-af21-ae2627d742fc" released by "delete_volume" :: held 0.735s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:40 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Created reservations ['7e07c833-6481-49bd-b3ce-1993a8c30b47', '5345e5ed-4677-4e14-a7bd-de697b24ecfa', '37d2b9b4-a47b-436f-bfc9-c5ff3d92e2dc', '3aece1d0-3ff8-4a40-9b17-cc802814b747'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:26:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:40 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:40 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.085s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:40 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:26:40 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Deleted volume successfully.
Sep 16 11:26:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-afcca13e-19f9-4717-92b1-07ee7529f678 tempest-VolumesActionsTest-2051316274 None] Lock "cinder-dde80443-4f98-4533-af21-ae2627d742fc-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:44 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:44 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:26:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (f6cee3d3-f12f-4998-9117-b466411e3d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef4e6b8-4e9f-471b-93f9-a3b28af9cbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef4e6b8-4e9f-471b-93f9-a3b28af9cbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1369376872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbadfa5c-80e7-404c-b8ae-7637ee93ea61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:44Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b67000-8094-4254-952f-55803074fadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b67000-8094-4254-952f-55803074fadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c61c23-7c6a-4fb3-aade-c5cacb1e40f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c61c23-7c6a-4fb3-aade-c5cacb1e40f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbadfa5c-80e7-404c-b8ae-7637ee93ea61', 'volume_name': 'volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b720f4f0-582e-4962-bdad-4912a1ec1420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b720f4f0-582e-4962-bdad-4912a1ec1420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bc8f6a-f4fc-42da-96e7-4ed53e831045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:46 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Volume fbadfa5c-80e7-404c-b8ae-7637ee93ea61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61', 'volume_size': 1}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1369376872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbadfa5c-80e7-404c-b8ae-7637ee93ea61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:44Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Creating volume fbadfa5c-80e7-404c-b8ae-7637ee93ea61 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.114s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:26:46 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:26:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:47 devstack quobyte-client[83411]: System call of process 94216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:26:47 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=35, name=volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:26:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61 1073741824" returned: 0 in 0.783s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61" returned: 0 in 0.273s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] <== create_volume: return (1421ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:26:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bc8f6a-f4fc-42da-96e7-4ed53e831045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcaffedb-a5e9-49bb-85bd-ade28380ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:48 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Volume volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61 (fbadfa5c-80e7-404c-b8ae-7637ee93ea61): created successfully
Sep 16 11:26:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcaffedb-a5e9-49bb-85bd-ade28380ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (f6cee3d3-f12f-4998-9117-b466411e3d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:48 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-523c6b26-ed6d-4163-ba90-898332024f30 tempest-VolumesActionsTest-1997144303 None] Created volume successfully.
Sep 16 11:26:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Acquiring lock "cinder-fbadfa5c-80e7-404c-b8ae-7637ee93ea61-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Lock "cinder-fbadfa5c-80e7-404c-b8ae-7637ee93ea61-delete_volume" acquired by "delete_volume" :: waited 0.194s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:50 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Acquiring lock "cinder-quobyte-fbadfa5c-80e7-404c-b8ae-7637ee93ea61" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Lock "cinder-quobyte-fbadfa5c-80e7-404c-b8ae-7637ee93ea61" acquired by "delete_volume" :: waited 0.027s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:50 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5b1119-ad74-414c-8e53-0b880e26b2df]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:26:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:51 devstack quobyte-client[83411]: System call of process 94238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:26:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61" returned: 0 in 1.385s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fbadfa5c-80e7-404c-b8ae-7637ee93ea61" returned: 0 in 0.189s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Lock "cinder-quobyte-fbadfa5c-80e7-404c-b8ae-7637ee93ea61" released by "delete_volume" :: held 2.054s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:52 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Created reservations ['fe86912e-3e81-40c8-bba4-55a8de3ebbbe', 'c162f74f-0835-4f8b-971a-80806dba93a2', '0a9e6a4f-9410-4c26-8240-ff8b6ac28c44', '829bac81-26d3-42be-bbd7-f4c17a4a22df'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:26:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.191s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:53 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:26:53 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Deleted volume successfully.
Sep 16 11:26:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d0950a72-1255-4a04-97c5-483ccb8c2a9f tempest-VolumesActionsTest-2051316274 None] Lock "cinder-fbadfa5c-80e7-404c-b8ae-7637ee93ea61-delete_volume" released by "delete_volume" :: held 4.160s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:54 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (075bad63-284b-472e-a315-7cf4af14c373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842f03c3-1617-407a-8b1f-a972f0d32f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842f03c3-1617-407a-8b1f-a972f0d32f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-797084535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:54Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02447954-f1f9-48e3-8472-2dc42a7ee139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02447954-f1f9-48e3-8472-2dc42a7ee139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299b8849-bae7-40a5-9b32-1f8dd5a5677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299b8849-bae7-40a5-9b32-1f8dd5a5677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a', 'volume_name': 'volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24347bfa-347a-4e80-a258-0d34cba63580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24347bfa-347a-4e80-a258-0d34cba63580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da44588f-6c5a-4a14-9ae7-5f6c796e0dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:54 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Volume ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a', 'volume_size': 1}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-797084535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:26:54Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Creating volume ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:26:54 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:26:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:54 devstack quobyte-client[83411]: System call of process 94250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:26:54 devstack quobyte-client[83411]: System call of process 94250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:26:54 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=36, name=volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:26:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a 1073741824" returned: 0 in 0.394s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a" returned: 0 in 0.245s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] <== create_volume: return (715ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:26:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:55 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da44588f-6c5a-4a14-9ae7-5f6c796e0dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:55 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7efe80-f062-4ff7-a653-13187cbbdadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:26:55 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=34,cinder:UPDATE=66,cinder:DELETE=6,cinder:INSERT=7 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:26:55 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Volume volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a (ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a): created successfully
Sep 16 11:26:55 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7efe80-f062-4ff7-a653-13187cbbdadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:26:55 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (075bad63-284b-472e-a315-7cf4af14c373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:26:55 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8f5d3b4b-eb6c-49bd-9937-07bc5e5a2c09 tempest-VolumesActionsTest-1997144303 None] Created volume successfully.
Sep 16 11:26:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Acquiring lock "cinder-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Lock "cinder-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:57 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:26:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Acquiring lock "cinder-quobyte-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:26:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Lock "cinder-quobyte-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a" acquired by "delete_volume" :: waited 0.014s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:26:57 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb77286-c1d1-4158-93bf-7fb7374ddb72]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:26:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a" returned: 0 in 0.456s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a" returned: 0 in 0.161s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Lock "cinder-quobyte-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a" released by "delete_volume" :: held 0.838s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:26:58 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Created reservations ['7c7aab2e-fb85-4b9b-9df8-ffd1e5a53854', 'fe0fe566-3e8f-485a-ab1f-df780ed0b58e', 'e9a6ded9-07c2-422e-8c1e-b6c6d7e9bee2', '05bcf746-3728-4f57-b323-abfd85b602d0'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:26:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:26:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:26:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:26:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:26:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:26:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:26:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.459s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:26:59 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:26:59 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Deleted volume successfully.
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f6fae98e-e3b5-469f-9db7-acca76f8be99 tempest-VolumesActionsTest-2051316274 None] Lock "cinder-ecf1515a-9dd6-4fd8-8f88-d6c00b0c420a-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:00 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (a85a4ce8-ade0-4847-8f03-82a5ced6b4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c867ea-152e-44c8-99c0-6d8c4f6b90c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c867ea-152e-44c8-99c0-6d8c4f6b90c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-188490218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fd2a2d-e958-4717-9239-834b00c7b63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:27:00Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0630f930-102b-4dfc-a1f4-d8187c6da59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0630f930-102b-4dfc-a1f4-d8187c6da59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911302f8-3b1e-4332-8264-f52a89673fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911302f8-3b1e-4332-8264-f52a89673fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fd2a2d-e958-4717-9239-834b00c7b63b', 'volume_name': 'volume-b0fd2a2d-e958-4717-9239-834b00c7b63b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a41f2443-eb13-42dd-86f7-aa161c694f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a41f2443-eb13-42dd-86f7-aa161c694f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2386d1ce-c5f4-40f9-9cb9-376ad61092ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:00 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Volume b0fd2a2d-e958-4717-9239-834b00c7b63b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fd2a2d-e958-4717-9239-834b00c7b63b', 'volume_size': 1}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-188490218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fd2a2d-e958-4717-9239-834b00c7b63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d07cde91b9a41c7838ffd69af7b165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:27:00Z,use_quota=True,user_id='a3a665627aeb49118aec375a4c752b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Creating volume b0fd2a2d-e958-4717-9239-834b00c7b63b {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:27:00 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:27:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b0fd2a2d-e958-4717-9239-834b00c7b63b 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:00 devstack quobyte-client[83411]: System call of process 94284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:00 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=37, name=volume-b0fd2a2d-e958-4717-9239-834b00c7b63b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:27:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b0fd2a2d-e958-4717-9239-834b00c7b63b 1073741824" returned: 0 in 0.984s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b0fd2a2d-e958-4717-9239-834b00c7b63b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b0fd2a2d-e958-4717-9239-834b00c7b63b" returned: 0 in 0.370s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] <== create_volume: return (1702ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:27:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:27:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2386d1ce-c5f4-40f9-9cb9-376ad61092ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fd2a2d-e958-4717-9239-834b00c7b63b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7211e4-6d6a-4650-a809-eeaae3f7d1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:02 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Volume volume-b0fd2a2d-e958-4717-9239-834b00c7b63b (b0fd2a2d-e958-4717-9239-834b00c7b63b): created successfully
Sep 16 11:27:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7211e4-6d6a-4650-a809-eeaae3f7d1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Flow 'volume_create_manager' (a85a4ce8-ade0-4847-8f03-82a5ced6b4e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:27:03 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=54,cinder:SELECT=54,cinder:INSERT=18,cinder:DELETE=5 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:27:03 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-29517e08-6769-4569-a65e-608f70457a80 tempest-VolumesActionsTest-1997144303 None] Created volume successfully.
Sep 16 11:27:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Acquiring lock "cinder-b0fd2a2d-e958-4717-9239-834b00c7b63b-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Lock "cinder-b0fd2a2d-e958-4717-9239-834b00c7b63b-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:06 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:27:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Acquiring lock "cinder-quobyte-b0fd2a2d-e958-4717-9239-834b00c7b63b" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Lock "cinder-quobyte-b0fd2a2d-e958-4717-9239-834b00c7b63b" acquired by "delete_volume" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:06 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac07a680-5140-48d1-825f-da15272de5c9]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:27:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b0fd2a2d-e958-4717-9239-834b00c7b63b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:06 devstack quobyte-client[83411]: System call of process 94347 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b0fd2a2d-e958-4717-9239-834b00c7b63b" returned: 0 in 0.980s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b0fd2a2d-e958-4717-9239-834b00c7b63b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b0fd2a2d-e958-4717-9239-834b00c7b63b" returned: 0 in 0.130s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Lock "cinder-quobyte-b0fd2a2d-e958-4717-9239-834b00c7b63b" released by "delete_volume" :: held 1.355s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:07 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Created reservations ['c2f6cad5-6a7a-4d58-a0cf-4f62cf35dac3', '3423275f-1341-40de-b736-24e93638216c', '548a8c70-386e-4f4d-a822-c13e3f3fa2a5', 'b314a467-c0fd-45b4-905e-458ea8916f65'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:27:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:27:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:27:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:27:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:27:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:27:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.246s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:08 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:27:08 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Deleted volume successfully.
Sep 16 11:27:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6539b9c7-a679-4aee-b258-efed1b5bde4e tempest-VolumesActionsTest-1997144303 None] Lock "cinder-b0fd2a2d-e958-4717-9239-834b00c7b63b-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:17 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:27:18 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=21,cinder:SELECT=11,cinder:INSERT=5,cinder:DELETE=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:27:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:27:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:27:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:27:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:27:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:27:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:27:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.126s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:27:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Acquiring lock "cinder-207c0b8a-a938-440d-91ca-b1447a4f137a-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Lock "cinder-207c0b8a-a938-440d-91ca-b1447a4f137a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:33 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:27:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Acquiring lock "cinder-quobyte-207c0b8a-a938-440d-91ca-b1447a4f137a" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Lock "cinder-quobyte-207c0b8a-a938-440d-91ca-b1447a4f137a" acquired by "delete_volume" :: waited 0.023s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:33 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70fe0e2-120e-4323-80f5-2b4c10a949b0]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:27:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-207c0b8a-a938-440d-91ca-b1447a4f137a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:34 devstack quobyte-client[83411]: System call of process 94493 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-207c0b8a-a938-440d-91ca-b1447a4f137a" returned: 0 in 0.869s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-207c0b8a-a938-440d-91ca-b1447a4f137a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-207c0b8a-a938-440d-91ca-b1447a4f137a" returned: 0 in 0.264s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Lock "cinder-quobyte-207c0b8a-a938-440d-91ca-b1447a4f137a" released by "delete_volume" :: held 1.546s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:35 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Created reservations ['5cb2c72d-574d-457b-9f32-a2e0ad401b34', '633b80b4-5402-411e-b3e9-66a3f474f303', '7cdc56c0-9434-4eb5-be37-6582368c49c8', '98d49e50-5564-4fbb-bf4d-fc116c8146a4'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:27:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:27:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.046s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:27:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:27:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:27:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:27:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.509s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:27:36 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Deleted volume successfully.
Sep 16 11:27:36 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Flow 'volume_create_manager' (d88f7a2a-f646-4c95-8631-0795e61a74f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565ffa64-6969-4c20-84d9-45d06d21b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565ffa64-6969-4c20-84d9-45d06d21b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1749756745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802bdb74-c430-4e4a-865e-90278ad0ab3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e513585e604c99a88a592da892c179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:27:36Z,use_quota=True,user_id='7a933d2474454554abac087a7e657051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad8a423-742b-4ddd-9836-4284f7aeceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad8a423-742b-4ddd-9836-4284f7aeceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9d9084-0736-4ec3-aca2-962d180865a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9d9084-0736-4ec3-aca2-962d180865a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802bdb74-c430-4e4a-865e-90278ad0ab3d', 'volume_name': 'volume-802bdb74-c430-4e4a-865e-90278ad0ab3d', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19e66fd-9563-4c46-9a14-667d962174b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19e66fd-9563-4c46-9a14-667d962174b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a972b022-97e1-49e1-8be0-b9b0a46f59f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:36 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Volume 802bdb74-c430-4e4a-865e-90278ad0ab3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802bdb74-c430-4e4a-865e-90278ad0ab3d', 'volume_size': 1}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1749756745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=802bdb74-c430-4e4a-865e-90278ad0ab3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e513585e604c99a88a592da892c179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:27:36Z,use_quota=True,user_id='7a933d2474454554abac087a7e657051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Creating volume 802bdb74-c430-4e4a-865e-90278ad0ab3d {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:27:36 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:27:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7111b525-9c50-404a-b911-902e284a9cae tempest-VolumesNegativeTest-2068338748 None] Lock "cinder-207c0b8a-a938-440d-91ca-b1447a4f137a-delete_volume" released by "delete_volume" :: held 4.501s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:37 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=38, name=volume-802bdb74-c430-4e4a-865e-90278ad0ab3d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:27:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d 1073741824" returned: 0 in 0.577s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d" returned: 0 in 0.161s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] <== create_volume: return (872ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:27:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:27:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a972b022-97e1-49e1-8be0-b9b0a46f59f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802bdb74-c430-4e4a-865e-90278ad0ab3d', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a63aa3-ce64-420c-a92f-a585bac26670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:27:38 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Volume volume-802bdb74-c430-4e4a-865e-90278ad0ab3d (802bdb74-c430-4e4a-865e-90278ad0ab3d): created successfully
Sep 16 11:27:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a63aa3-ce64-420c-a92f-a585bac26670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:27:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Flow 'volume_create_manager' (d88f7a2a-f646-4c95-8631-0795e61a74f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:27:38 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fbcc453e-f127-427d-bc70-0ca57e088cdb tempest-VolumesDeleteCascade-1641761569 None] Created volume successfully.
Sep 16 11:27:39 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:27:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:27:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:27:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Creating offline snapshot d9bc191d-3929-4f24-9989-85014b6ebf27 of volume 802bdb74-c430-4e4a-865e-90278ad0ab3d {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:27:39 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff9ab51-2f48-49e2-abde-1bca358f34b3]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:27:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d" returned: 0 in 0.874s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:40 devstack quobyte-client[83411]: System call of process 94523 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:40 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=39, name=volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:27:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 1G" returned: 0 in 0.618s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img rebase -u -b volume-802bdb74-c430-4e4a-865e-90278ad0ab3d -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img rebase -u -b volume-802bdb74-c430-4e4a-865e-90278ad0ab3d -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27" returned: 0 in 0.378s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:41 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:27:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27" returned: 0 in 0.321s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:27:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27" returned: 0 in 0.314s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.info" returned: 0 in 0.284s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:27:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.info" returned: 0 in 0.329s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.097s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:27:44 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-980b7b04-acb7-4a1e-98f9-621e77b09488 tempest-VolumesDeleteCascade-1641761569 None] Create snapshot completed successfully
Sep 16 11:27:45 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:27:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:27:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:27:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Creating offline snapshot 02648c8f-6553-475e-906e-fb88e2ca85fa of volume 802bdb74-c430-4e4a-865e-90278ad0ab3d {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:27:45 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[20104f19-ef38-4a4c-b874-d4e3a7a6288d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:27:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:46 devstack quobyte-client[83411]: System call of process 94573 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27" returned: 0 in 1.040s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802bdb74-c430-4e4a-865e-90278ad0ab3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:27:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:47 devstack quobyte-client[83411]: System call of process 94578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:47 devstack quobyte-client[83411]: System call of process 94578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:47 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=41, name=volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:27:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa 1G" returned: 0 in 0.567s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img rebase -u -b volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img rebase -u -b volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa" returned: 0 in 0.186s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:27:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa" returned: 0 in 0.150s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:27:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa" returned: 0 in 0.168s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.761s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:27:48 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3e78b920-1771-4e87-9162-12c6ec2fa08e tempest-VolumesDeleteCascade-1641761569 None] Create snapshot completed successfully
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-802bdb74-c430-4e4a-865e-90278ad0ab3d-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-802bdb74-c430-4e4a-865e-90278ad0ab3d-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:50 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Performing cascade delete. {{(pid=83386) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-02648c8f-6553-475e-906e-fb88e2ca85fa-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-02648c8f-6553-475e-906e-fb88e2ca85fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:50 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-802bdb74-c430-4e4a-865e-90278ad0ab3d" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-802bdb74-c430-4e4a-865e-90278ad0ab3d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-02648c8f-6553-475e-906e-fb88e2ca85fa" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-02648c8f-6553-475e-906e-fb88e2ca85fa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Deleting offline snapshot 02648c8f-6553-475e-906e-fb88e2ca85fa of volume 802bdb74-c430-4e4a-865e-90278ad0ab3d {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] snapshot_file for this snap is: volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94a4132-6064-4d66-b44e-4f874f621d62]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:27:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:51 devstack quobyte-client[83411]: System call of process 94587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa" returned: 0 in 0.658s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802bdb74-c430-4e4a-865e-90278ad0ab3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:27:51 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd7611-ce33-4efc-a578-995cffb9ae37]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:27:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27" returned: 0 in 0.564s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802bdb74-c430-4e4a-865e-90278ad0ab3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:27:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:52 devstack quobyte-client[83411]: System call of process 94594 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa" returned: 0 in 0.281s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.02648c8f-6553-475e-906e-fb88e2ca85fa" returned: 0 in 0.149s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-02648c8f-6553-475e-906e-fb88e2ca85fa" released by "_delete_snapshot" :: held 2.189s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-802bdb74-c430-4e4a-865e-90278ad0ab3d" released by "delete_snapshot" :: held 2.232s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:53 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Created reservations ['ea51a8b2-df9d-42be-894b-26df95b7ff8e', '816677f1-7328-47ce-85c9-9c24292b7f09', '3fb36cc9-622a-477d-ad39-9c1c348a70cc', 'ffa017fd-53dc-45f2-bed7-ac3c1262aa44'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:27:53 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Delete snapshot completed successfully.
Sep 16 11:27:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-02648c8f-6553-475e-906e-fb88e2ca85fa-delete_snapshot" released by "delete_snapshot" :: held 3.399s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-d9bc191d-3929-4f24-9989-85014b6ebf27-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-d9bc191d-3929-4f24-9989-85014b6ebf27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:53 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:27:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-802bdb74-c430-4e4a-865e-90278ad0ab3d" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-802bdb74-c430-4e4a-865e-90278ad0ab3d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-d9bc191d-3929-4f24-9989-85014b6ebf27" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-d9bc191d-3929-4f24-9989-85014b6ebf27" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Deleting offline snapshot d9bc191d-3929-4f24-9989-85014b6ebf27 of volume 802bdb74-c430-4e4a-865e-90278ad0ab3d {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:27:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] snapshot_file for this snap is: volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:27:54 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c37411-8c18-467e-989f-6781ee7e21d7]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:27:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:54 devstack quobyte-client[83411]: System call of process 94598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27" returned: 0 in 0.777s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802bdb74-c430-4e4a-865e-90278ad0ab3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:27:55 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[8539eeee-2076-4b49-b932-53abf8350ddd]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:27:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d" returned: 0 in 0.863s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27" returned: 0 in 0.395s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d.d9bc191d-3929-4f24-9989-85014b6ebf27" returned: 0 in 0.228s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-d9bc191d-3929-4f24-9989-85014b6ebf27" released by "_delete_snapshot" :: held 2.848s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-802bdb74-c430-4e4a-865e-90278ad0ab3d" released by "delete_snapshot" :: held 2.915s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:57 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Created reservations ['60407a2a-d4ec-4455-bad7-2addcac6ce27', '4dfdbb60-ffef-41bd-adbd-b2687d6dbb4a', '804c3d9f-6e66-4e55-a92f-b8ba1056d17e', '22d5a630-8b08-476e-893a-84fb91de7a4d'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:27:58 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Delete snapshot completed successfully.
Sep 16 11:27:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-d9bc191d-3929-4f24-9989-85014b6ebf27-delete_snapshot" released by "delete_snapshot" :: held 4.076s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:27:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Snapshots deleted, issuing volume delete {{(pid=83386) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 16 11:27:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-802bdb74-c430-4e4a-865e-90278ad0ab3d" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:27:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-802bdb74-c430-4e4a-865e-90278ad0ab3d" acquired by "delete_volume" :: waited 0.094s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:27:58 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d02e4d-cf63-4cfd-b56a-28f4af73c4c0]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:27:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:58 devstack quobyte-client[83411]: System call of process 94608 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:27:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d" returned: 0 in 0.728s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:27:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-802bdb74-c430-4e4a-865e-90278ad0ab3d" returned: 0 in 0.353s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:27:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-802bdb74-c430-4e4a-865e-90278ad0ab3d" released by "delete_volume" :: held 1.657s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:00 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Created reservations ['840cfb28-1fde-4f9c-894f-e28d0c8e58b0', 'abab9ab1-0db4-4a62-94bf-c4bb085b6ca6', '73256ecb-cd68-43bd-83a8-d2da3a7e9409', '413858fb-ab2a-4ef0-b3b1-e71637248cd4'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:28:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.359s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:01 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:28:02 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Deleted volume successfully.
Sep 16 11:28:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c7341576-8bed-4216-a1f6-0633d29a7c11 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-802bdb74-c430-4e4a-865e-90278ad0ab3d-delete_volume" released by "delete_volume" :: held 12.243s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:03 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Flow 'volume_create_manager' (cf63650a-ddaa-44df-93dc-2f8472ba828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae45514-9c78-4153-a413-8f5257570148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae45514-9c78-4153-a413-8f5257570148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-115860364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fe18d4-c847-46f1-9e48-5cdde5851514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e513585e604c99a88a592da892c179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:03Z,use_quota=True,user_id='7a933d2474454554abac087a7e657051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad1da89-3f3e-44e6-b595-f65b7e1be861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad1da89-3f3e-44e6-b595-f65b7e1be861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacc8b38-4ba2-4a8c-81b8-503091579dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacc8b38-4ba2-4a8c-81b8-503091579dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4fe18d4-c847-46f1-9e48-5cdde5851514', 'volume_name': 'volume-e4fe18d4-c847-46f1-9e48-5cdde5851514', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560a4220-115b-42c3-a739-6b4e0dd36a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560a4220-115b-42c3-a739-6b4e0dd36a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab2da99-409a-4a5b-92c8-c35ae9498413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:03 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Volume e4fe18d4-c847-46f1-9e48-5cdde5851514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4fe18d4-c847-46f1-9e48-5cdde5851514', 'volume_size': 1}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-115860364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fe18d4-c847-46f1-9e48-5cdde5851514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e513585e604c99a88a592da892c179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:03Z,use_quota=True,user_id='7a933d2474454554abac087a7e657051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Creating volume e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:28:03 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:28:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:04 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=42, name=volume-e4fe18d4-c847-46f1-9e48-5cdde5851514, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:28:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 1073741824" returned: 0 in 0.553s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514" returned: 0 in 0.134s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:04 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] <== create_volume: return (809ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:28:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab2da99-409a-4a5b-92c8-c35ae9498413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4fe18d4-c847-46f1-9e48-5cdde5851514', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0c933a-b6f9-4995-8ad2-44191c4008c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:05 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Volume volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 (e4fe18d4-c847-46f1-9e48-5cdde5851514): created successfully
Sep 16 11:28:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0c933a-b6f9-4995-8ad2-44191c4008c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Flow 'volume_create_manager' (cf63650a-ddaa-44df-93dc-2f8472ba828a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:05 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ff646f79-8736-4574-bd1f-86c9470d1d25 tempest-VolumesDeleteCascade-1641761569 None] Created volume successfully.
Sep 16 11:28:06 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Creating offline snapshot d58058de-a80a-4b77-86a9-7110c8a53a7c of volume e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:28:06 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a27d596-8f50-4459-8f51-068fbec6754e]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:07 devstack quobyte-client[83411]: System call of process 94625 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:28:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514" returned: 0 in 0.722s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:07 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=43, name=volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:28:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c 1G" returned: 0 in 0.287s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img rebase -u -b volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c" returned: 0 in 0.143s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c" returned: 0 in 0.136s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c" returned: 0 in 0.117s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.info" returned: 0 in 0.132s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.info" returned: 0 in 0.113s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.154s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:09 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5fa12d18-f636-4ae9-9365-14f00cd579a2 tempest-VolumesDeleteCascade-1641761569 None] Create snapshot completed successfully
Sep 16 11:28:10 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Flow 'volume_create_manager' (1dbde7b7-874c-4128-90b9-0d7ff746ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d2f90c-43ab-45ca-a7e1-16fa130dfcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d2f90c-43ab-45ca-a7e1-16fa130dfcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-607042829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049716c9-33c6-48ce-9134-8c05621dcbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e513585e604c99a88a592da892c179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d58058de-a80a-4b77-86a9-7110c8a53a7c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:10Z,use_quota=True,user_id='7a933d2474454554abac087a7e657051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1084664-440e-4db9-a3d5-bc6086eda656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1084664-440e-4db9-a3d5-bc6086eda656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e39a02d-1da3-45a3-892a-5baf1da325dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e39a02d-1da3-45a3-892a-5baf1da325dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '049716c9-33c6-48ce-9134-8c05621dcbd6', 'volume_name': 'volume-049716c9-33c6-48ce-9134-8c05621dcbd6', 'volume_size': 1, 'snapshot_id': 'd58058de-a80a-4b77-86a9-7110c8a53a7c'}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93f5013-e092-4ac3-a35c-6d6b95acba56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93f5013-e092-4ac3-a35c-6d6b95acba56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d53d9a-0b28-45f4-9e68-995002354606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:10 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Volume 049716c9-33c6-48ce-9134-8c05621dcbd6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-049716c9-33c6-48ce-9134-8c05621dcbd6', 'volume_size': 1, 'snapshot_id': 'd58058de-a80a-4b77-86a9-7110c8a53a7c'}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-d58058de-a80a-4b77-86a9-7110c8a53a7c-049716c9-33c6-48ce-9134-8c05621dcbd6" by "_create_volume_from_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-d58058de-a80a-4b77-86a9-7110c8a53a7c-049716c9-33c6-48ce-9134-8c05621dcbd6" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Creating volume 049716c9-33c6-48ce-9134-8c05621dcbd6 from snapshot d58058de-a80a-4b77-86a9-7110c8a53a7c {{(pid=83386) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-049716c9-33c6-48ce-9134-8c05621dcbd6" by "_copy_volume_from_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-049716c9-33c6-48ce-9134-8c05621dcbd6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] snapshot: d58058de-a80a-4b77-86a9-7110c8a53a7c, volume: 049716c9-33c6-48ce-9134-8c05621dcbd6,  {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1b7473-b35e-4663-9b44-5427f533b65d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c" returned: 0 in 0.584s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4fe18d4-c847-46f1-9e48-5cdde5851514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:28:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 16 11:28:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Creating direct copy from snapshot {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 16 11:28:11 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc32987c-3a52-4fba-b0f6-fe427f5aa119]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514" returned: 0 in 0.766s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:12 devstack cinder-volume[83386]: DEBUG cinder.utils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6 not found in is_blk_device check {{(pid=83386) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 16 11:28:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:12 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=45, name=volume-049716c9-33c6-48ce-9134-8c05621dcbd6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:28:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6" returned: 0 in 8.177s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:20 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4ebf5-bc49-4f73-9932-4f462177ea17]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:20 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=49,cinder:SELECT=31,cinder:INSERT=5,cinder:DELETE=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:28:20 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=27,cinder:INSERT=11,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:28:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514" returned: 0 in 0.798s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:21 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Image conversion details: src /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514, size 1024.00 MB, duration 8.22 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6 {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:28:21 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Converted 1024.00 MB image at 124.64 MB/s
Sep 16 11:28:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:28:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6" returned: 0 in 0.142s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-049716c9-33c6-48ce-9134-8c05621dcbd6" released by "_copy_volume_from_snapshot" :: held 10.911s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-d58058de-a80a-4b77-86a9-7110c8a53a7c-049716c9-33c6-48ce-9134-8c05621dcbd6" released by "_create_volume_from_snapshot" :: held 10.954s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.981s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d53d9a-0b28-45f4-9e68-995002354606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049716c9-33c6-48ce-9134-8c05621dcbd6', 'volume_size': 1, 'snapshot_id': 'd58058de-a80a-4b77-86a9-7110c8a53a7c'}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e01b613-3188-401e-bccc-ff41dddfd5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:22 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Volume volume-049716c9-33c6-48ce-9134-8c05621dcbd6 (049716c9-33c6-48ce-9134-8c05621dcbd6): created successfully
Sep 16 11:28:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e01b613-3188-401e-bccc-ff41dddfd5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Flow 'volume_create_manager' (1dbde7b7-874c-4128-90b9-0d7ff746ab59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:22 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2f343b64-0069-4c3c-8832-b896685534e4 tempest-VolumesDeleteCascade-1641761569 None] Created volume successfully.
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-e4fe18d4-c847-46f1-9e48-5cdde5851514-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-e4fe18d4-c847-46f1-9e48-5cdde5851514-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:23 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Performing cascade delete. {{(pid=83386) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-d58058de-a80a-4b77-86a9-7110c8a53a7c-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-d58058de-a80a-4b77-86a9-7110c8a53a7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:23 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-e4fe18d4-c847-46f1-9e48-5cdde5851514" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-e4fe18d4-c847-46f1-9e48-5cdde5851514" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-d58058de-a80a-4b77-86a9-7110c8a53a7c" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-d58058de-a80a-4b77-86a9-7110c8a53a7c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Deleting offline snapshot d58058de-a80a-4b77-86a9-7110c8a53a7c of volume e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] snapshot_file for this snap is: volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[5050f3d9-f95c-4c27-b96b-3e2dac2df7eb]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c" returned: 0 in 0.444s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4fe18d4-c847-46f1-9e48-5cdde5851514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:28:24 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cbfbb0-a027-4b50-9db6-5f3b90a20b8c]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:24 devstack quobyte-client[83411]: System call of process 94687 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:28:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514" returned: 0 in 0.528s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c" returned: 0 in 0.258s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514.d58058de-a80a-4b77-86a9-7110c8a53a7c" returned: 0 in 0.092s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-d58058de-a80a-4b77-86a9-7110c8a53a7c" released by "_delete_snapshot" :: held 1.660s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-e4fe18d4-c847-46f1-9e48-5cdde5851514" released by "delete_snapshot" :: held 1.694s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.245s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:28:26 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Created reservations ['e845cef7-2b82-45cc-b936-a0d291ded409', '28aad865-7ebd-42f8-a432-96ebf880cdb0', '462a7fba-fc3b-40b4-b287-74a05991e76f', 'c25d312e-b37a-4363-be67-0d1279901f40'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:28:26 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Delete snapshot completed successfully.
Sep 16 11:28:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-d58058de-a80a-4b77-86a9-7110c8a53a7c-delete_snapshot" released by "delete_snapshot" :: held 2.684s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Snapshots deleted, issuing volume delete {{(pid=83386) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 16 11:28:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-e4fe18d4-c847-46f1-9e48-5cdde5851514" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-e4fe18d4-c847-46f1-9e48-5cdde5851514" acquired by "delete_volume" :: waited 0.018s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:26 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[97935eed-f0a7-4bd2-8c69-546daf7806e8]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514" returned: 0 in 0.530s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4fe18d4-c847-46f1-9e48-5cdde5851514" returned: 0 in 0.114s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-e4fe18d4-c847-46f1-9e48-5cdde5851514" released by "delete_volume" :: held 0.858s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Created reservations ['32eb7741-5bce-477c-920a-4cba83d10ce1', '18de1143-8565-420f-aab6-dee3a065a3ad', '395df53b-0cea-4eaa-870a-acfb07348d9f', '4d36eb0b-c248-42f9-9242-e5c933438106'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.112s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:28:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Deleted volume successfully.
Sep 16 11:28:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6777c783-7f51-4731-ad90-4bfe8e5b23ca tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-e4fe18d4-c847-46f1-9e48-5cdde5851514-delete_volume" released by "delete_volume" :: held 4.745s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-049716c9-33c6-48ce-9134-8c05621dcbd6-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-049716c9-33c6-48ce-9134-8c05621dcbd6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:28 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "cinder-quobyte-049716c9-33c6-48ce-9134-8c05621dcbd6" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-049716c9-33c6-48ce-9134-8c05621dcbd6" acquired by "delete_volume" :: waited 0.020s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:28 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71ba145-bdfa-4b62-90b6-8902417d5196]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:29 devstack quobyte-client[83411]: System call of process 94700 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:28:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6" returned: 0 in 0.518s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-049716c9-33c6-48ce-9134-8c05621dcbd6" returned: 0 in 0.161s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:29 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-quobyte-049716c9-33c6-48ce-9134-8c05621dcbd6" released by "delete_volume" :: held 0.956s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:30 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Created reservations ['a64c5e12-7419-45b6-b186-0e04bf8fccf7', 'fb90a35d-02f4-4233-94ba-4a4602ea97cf', '6cba86d6-e605-4189-ae20-97955e6ce293', '1dc6e6e0-4aed-4c2e-81ac-c246026528f2'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:28:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.107s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:30 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:28:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Deleted volume successfully.
Sep 16 11:28:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-75eb1059-3546-42af-b044-51c7534fa0cf tempest-VolumesDeleteCascade-1641761569 None] Lock "cinder-049716c9-33c6-48ce-9134-8c05621dcbd6-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:31 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:31 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:28:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Flow 'volume_create_manager' (e8944a69-21d3-48b9-9ad3-965d7d4032a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd5ae95-e04a-46fb-9658-bd34ab5f5814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd5ae95-e04a-46fb-9658-bd34ab5f5814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1279047765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3313228e-2dbb-4e5a-bbfb-43fc62958ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8159de10e94669b9176fc17de59da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:31Z,use_quota=True,user_id='62a93701170146ebaecbf4ed322a2089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69412bbd-d51a-41d9-b52c-3910b9437416),volume_type_id=69412bbd-d51a-41d9-b52c-3910b9437416)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0f5f9a-94e4-4c95-82b4-e7941f6d5e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a0f5f9a-94e4-4c95-82b4-e7941f6d5e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd70adf9-87fd-4787-9fa4-4a2f14203893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd70adf9-87fd-4787-9fa4-4a2f14203893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3313228e-2dbb-4e5a-bbfb-43fc62958ea5', 'volume_name': 'volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debb948f-8fd9-447a-8a9e-4b28cd97ebdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (debb948f-8fd9-447a-8a9e-4b28cd97ebdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1980580-10e8-4952-bbe0-b662c872df36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:32 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume 3313228e-2dbb-4e5a-bbfb-43fc62958ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5', 'volume_size': 1}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1279047765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3313228e-2dbb-4e5a-bbfb-43fc62958ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8159de10e94669b9176fc17de59da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:31Z,use_quota=True,user_id='62a93701170146ebaecbf4ed322a2089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69412bbd-d51a-41d9-b52c-3910b9437416),volume_type_id=69412bbd-d51a-41d9-b52c-3910b9437416)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Creating volume 3313228e-2dbb-4e5a-bbfb-43fc62958ea5 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:28:32 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:28:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:32 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=46, name=volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:28:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5 1073741824" returned: 0 in 1.047s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:33 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:33 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:28:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Flow 'volume_create_manager' (7efc60e2-71d3-4093-acc2-bee88ca94966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6ac41c-83b1-4047-8627-b70d67fb01d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5" returned: 0 in 0.877s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] <== create_volume: return (1960ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6ac41c-83b1-4047-8627-b70d67fb01d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2144232807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9801619-0e4b-453b-aa2b-9591ddba3da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8159de10e94669b9176fc17de59da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:33Z,use_quota=True,user_id='62a93701170146ebaecbf4ed322a2089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d54545f5-fce6-437d-9c14-9684b48d95b3),volume_type_id=d54545f5-fce6-437d-9c14-9684b48d95b3)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f464ea-bdf1-4cea-aa8f-6cb0d4e7a2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4f464ea-bdf1-4cea-aa8f-6cb0d4e7a2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf9441b-f39e-4094-8a1f-3bdd268cc2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf9441b-f39e-4094-8a1f-3bdd268cc2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9801619-0e4b-453b-aa2b-9591ddba3da2', 'volume_name': 'volume-b9801619-0e4b-453b-aa2b-9591ddba3da2', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa40ba8-00d4-44ad-b907-d7cc438d9021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa40ba8-00d4-44ad-b907-d7cc438d9021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc038bc-0c55-45a3-a361-cdb080121e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:34 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume b9801619-0e4b-453b-aa2b-9591ddba3da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9801619-0e4b-453b-aa2b-9591ddba3da2', 'volume_size': 1}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2144232807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9801619-0e4b-453b-aa2b-9591ddba3da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8159de10e94669b9176fc17de59da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:33Z,use_quota=True,user_id='62a93701170146ebaecbf4ed322a2089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d54545f5-fce6-437d-9c14-9684b48d95b3),volume_type_id=d54545f5-fce6-437d-9c14-9684b48d95b3)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Creating volume b9801619-0e4b-453b-aa2b-9591ddba3da2 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:28:34 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b9801619-0e4b-453b-aa2b-9591ddba3da2 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:34 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=47, name=volume-b9801619-0e4b-453b-aa2b-9591ddba3da2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:28:34 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:34 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Flow 'volume_create_manager' (8496015a-9ea1-418a-8f36-247aeed6a54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6dd40f0-88b3-48d9-bc70-796f7627aa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1980580-10e8-4952-bbe0-b662c872df36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168d0a51-6d7a-402f-b454-6c3d84c9cb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b9801619-0e4b-453b-aa2b-9591ddba3da2 1073741824" returned: 0 in 0.883s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b9801619-0e4b-453b-aa2b-9591ddba3da2 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6dd40f0-88b3-48d9-bc70-796f7627aa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-484355400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf64b3d6-4ea7-4b0d-a855-db51c17c1dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8159de10e94669b9176fc17de59da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:34Z,use_quota=True,user_id='62a93701170146ebaecbf4ed322a2089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(869739ff-606a-4fe7-b210-57f8098811c5),volume_type_id=869739ff-606a-4fe7-b210-57f8098811c5)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81829193-9f5d-429a-b42d-c07fa3a636d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81829193-9f5d-429a-b42d-c07fa3a636d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fcdce7e-d38a-4e42-b1e3-6d5ab762efc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:35 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5 (3313228e-2dbb-4e5a-bbfb-43fc62958ea5): created successfully
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168d0a51-6d7a-402f-b454-6c3d84c9cb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Flow 'volume_create_manager' (e8944a69-21d3-48b9-9ad3-965d7d4032a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b9801619-0e4b-453b-aa2b-9591ddba3da2" returned: 0 in 0.596s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] <== create_volume: return (1560ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:35 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8ffaef50-3c03-4fc5-88f8-79d40109ad14 tempest-TestInstancesWithCinderVolumes-1461621892 None] Created volume successfully.
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc038bc-0c55-45a3-a361-cdb080121e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9801619-0e4b-453b-aa2b-9591ddba3da2', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c9d8c8-1e4e-4181-916a-b8bba04a0c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:35 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume volume-b9801619-0e4b-453b-aa2b-9591ddba3da2 (b9801619-0e4b-453b-aa2b-9591ddba3da2): created successfully
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c9d8c8-1e4e-4181-916a-b8bba04a0c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Flow 'volume_create_manager' (7efc60e2-71d3-4093-acc2-bee88ca94966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:36 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-094b4b4a-0009-4506-ab7b-f66617bb699f tempest-TestInstancesWithCinderVolumes-1461621892 None] Created volume successfully.
Sep 16 11:28:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fcdce7e-d38a-4e42-b1e3-6d5ab762efc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf64b3d6-4ea7-4b0d-a855-db51c17c1dde', 'volume_name': 'volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde', 'volume_size': 1, 'image_id': '13854d1c-3e34-4df3-b2da-8c21cec8f4d0', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1079825960', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f8159de10e94669b9176fc17de59da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '13854d1c-3e34-4df3-b2da-8c21cec8f4d0', 'created_at': datetime.datetime(2025, 9, 16, 9, 28, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 9, 28, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13854d1c-3e34-4df3-b2da-8c21cec8f4d0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8933b35b0>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69779b8-5402-46f8-9553-ca2659faaadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69779b8-5402-46f8-9553-ca2659faaadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9076cfb9-3b40-4cd5-908e-ee771fc866db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:36 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume cf64b3d6-4ea7-4b0d-a855-db51c17c1dde: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde', 'volume_size': 1, 'image_id': '13854d1c-3e34-4df3-b2da-8c21cec8f4d0', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1079825960', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f8159de10e94669b9176fc17de59da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '13854d1c-3e34-4df3-b2da-8c21cec8f4d0', 'created_at': datetime.datetime(2025, 9, 16, 9, 28, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 9, 28, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13854d1c-3e34-4df3-b2da-8c21cec8f4d0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8933b35b0>}
Sep 16 11:28:36 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Cloning cf64b3d6-4ea7-4b0d-a855-db51c17c1dde from image 13854d1c-3e34-4df3-b2da-8c21cec8f4d0  at location (None, None). {{(pid=83386) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 16 11:28:38 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD, size 20.69 MB, duration 2.23 sec {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 16 11:28:38 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Image download 20.69 MB at 9.27 MB/s
Sep 16 11:28:38 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[479b19a7-bf1a-4407-b10e-eee737f87ace]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:39 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:28:39 devstack sudo[94732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD
Sep 16 11:28:39 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Flow 'volume_create_manager' (41d466e9-94b4-4f95-a755-00b7846749a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d6ca9b-128f-4b09-8fe8-2d451e378310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d6ca9b-128f-4b09-8fe8-2d451e378310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1061391606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65662b04-f1d5-44a7-86d0-459018584325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f11fbbb949471eab6ae34fc0ef5d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:39Z,use_quota=True,user_id='24a6f569a7b548779480623fba9f4a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bae524d-dd20-409f-b30d-9acf7888b6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bae524d-dd20-409f-b30d-9acf7888b6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f31cc8c-bdce-4d47-870b-92111859998a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f31cc8c-bdce-4d47-870b-92111859998a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65662b04-f1d5-44a7-86d0-459018584325', 'volume_name': 'volume-65662b04-f1d5-44a7-86d0-459018584325', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54dbd7c6-1a33-40c4-8042-d4291637449b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54dbd7c6-1a33-40c4-8042-d4291637449b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59c1bc8-2d10-4656-9247-e746bdd6636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:39 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Volume 65662b04-f1d5-44a7-86d0-459018584325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65662b04-f1d5-44a7-86d0-459018584325', 'volume_size': 1}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1061391606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65662b04-f1d5-44a7-86d0-459018584325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f11fbbb949471eab6ae34fc0ef5d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:39Z,use_quota=True,user_id='24a6f569a7b548779480623fba9f4a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Creating volume 65662b04-f1d5-44a7-86d0-459018584325 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:28:39 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-65662b04-f1d5-44a7-86d0-459018584325 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:39 devstack quobyte-client[83411]: System call of process 94734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:28:39 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=48, name=volume-65662b04-f1d5-44a7-86d0-459018584325, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-65662b04-f1d5-44a7-86d0-459018584325 1073741824" returned: 0 in 0.594s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-65662b04-f1d5-44a7-86d0-459018584325 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-65662b04-f1d5-44a7-86d0-459018584325" returned: 0 in 0.145s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:40 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] <== create_volume: return (837ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:28:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59c1bc8-2d10-4656-9247-e746bdd6636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65662b04-f1d5-44a7-86d0-459018584325', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41a459a-9768-4102-b00a-ed0a541abeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:40 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Volume volume-65662b04-f1d5-44a7-86d0-459018584325 (65662b04-f1d5-44a7-86d0-459018584325): created successfully
Sep 16 11:28:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41a459a-9768-4102-b00a-ed0a541abeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Flow 'volume_create_manager' (41d466e9-94b4-4f95-a755-00b7846749a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:40 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8d83e396-6e8c-44d1-aa88-a15720a2e6b9 tempest-VolumesTransfersV355Test-1632159967 None] Created volume successfully.
Sep 16 11:28:41 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root
Sep 16 11:28:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD" returned: 0 in 3.286s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:41 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Temporary image 13854d1c-3e34-4df3-b2da-8c21cec8f4d0 is fetched for user 62a93701170146ebaecbf4ed322a2089. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 16 11:28:42 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee3df47-d092-4b18-bde4-b80e5e4f232b]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-747e9aff-296c-4fe8-9738-d3b79a4f4b33 tempest-VolumesTransfersV355Test-388612493 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:42 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-747e9aff-296c-4fe8-9738-d3b79a4f4b33 tempest-VolumesTransfersV355Test-388612493 None] Transfer volume completed successfully.
Sep 16 11:28:43 devstack sudo[94743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD
Sep 16 11:28:43 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:28:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Acquiring lock "cinder-65662b04-f1d5-44a7-86d0-459018584325-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Lock "cinder-65662b04-f1d5-44a7-86d0-459018584325-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:44 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Acquiring lock "cinder-quobyte-65662b04-f1d5-44a7-86d0-459018584325" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Lock "cinder-quobyte-65662b04-f1d5-44a7-86d0-459018584325" acquired by "delete_volume" :: waited 0.029s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:44 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cccb2b-a5b9-4ee9-b5c4-a0ccbd43f302]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-65662b04-f1d5-44a7-86d0-459018584325 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-65662b04-f1d5-44a7-86d0-459018584325" returned: 0 in 1.048s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-65662b04-f1d5-44a7-86d0-459018584325 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:46 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root
Sep 16 11:28:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-65662b04-f1d5-44a7-86d0-459018584325" returned: 0 in 0.371s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Lock "cinder-quobyte-65662b04-f1d5-44a7-86d0-459018584325" released by "delete_volume" :: held 2.275s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD" returned: 0 in 5.522s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-484355400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf64b3d6-4ea7-4b0d-a855-db51c17c1dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f8159de10e94669b9176fc17de59da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:34Z,use_quota=True,user_id='62a93701170146ebaecbf4ed322a2089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(869739ff-606a-4fe7-b210-57f8098811c5),volume_type_id=869739ff-606a-4fe7-b210-57f8098811c5)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Creating volume cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:28:47 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:28:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:48 devstack quobyte-client[83411]: System call of process 94794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:28:48 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=49, name=volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:28:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde 1073741824" returned: 0 in 0.908s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:49 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Flow 'volume_create_manager' (b765963d-eaf5-4a65-bc6a-2eeda901cd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65c87a2-b8ae-4f3c-a67f-3dd327153dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65c87a2-b8ae-4f3c-a67f-3dd327153dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-126441602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d23e70-535f-4a26-becc-5f25160e04a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f68006c70c4c1ca3ea4b773680aeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:48Z,use_quota=True,user_id='c1dfb6ce0ac947bcbd9ef87c7aebcbc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1985150-ea1e-4687-89b4-eb8f1283bce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1985150-ea1e-4687-89b4-eb8f1283bce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af3eb54-349b-4952-8cfc-a1becafe802d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af3eb54-349b-4952-8cfc-a1becafe802d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d23e70-535f-4a26-becc-5f25160e04a9', 'volume_name': 'volume-29d23e70-535f-4a26-becc-5f25160e04a9', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fbf45f-0406-4ef5-8dc7-8b782dfa69d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fbf45f-0406-4ef5-8dc7-8b782dfa69d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f2e432-e86f-4d40-a3ff-f4e04c5608b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:49 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Volume 29d23e70-535f-4a26-becc-5f25160e04a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d23e70-535f-4a26-becc-5f25160e04a9', 'volume_size': 1}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" returned: 0 in 0.664s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] <== create_volume: return (1672ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-126441602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d23e70-535f-4a26-becc-5f25160e04a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f68006c70c4c1ca3ea4b773680aeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:48Z,use_quota=True,user_id='c1dfb6ce0ac947bcbd9ef87c7aebcbc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Creating volume 29d23e70-535f-4a26-becc-5f25160e04a9 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:28:49 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-29d23e70-535f-4a26-becc-5f25160e04a9 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:49 devstack quobyte-client[83411]: System call of process 94798 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:28:49 devstack quobyte-client[83411]: System call of process 94798 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:28:49 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=50, name=volume-29d23e70-535f-4a26-becc-5f25160e04a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:28:49 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Created reservations ['91129fd7-ab89-4f10-b6bc-44e8fa978e08', '7add1777-df20-4b62-b1cf-1f18f8ddf409', '5e65e66d-d3c3-4efc-b4ab-36809e8428ee', '3705b336-6d43-4ad5-b5b7-e4f0cc7bb6eb'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:28:50 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Attempting download of 13854d1c-3e34-4df3-b2da-8c21cec8f4d0 ((None, None)) to volume cf64b3d6-4ea7-4b0d-a855-db51c17c1dde. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 16 11:28:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-29d23e70-535f-4a26-becc-5f25160e04a9 1073741824" returned: 0 in 0.660s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-29d23e70-535f-4a26-becc-5f25160e04a9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-29d23e70-535f-4a26-becc-5f25160e04a9" returned: 0 in 0.514s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:50 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[7049d0ff-f5e8-40f9-afa9-48ed1c807199]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] <== create_volume: return (1217ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:28:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_8e2unapw {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f2e432-e86f-4d40-a3ff-f4e04c5608b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d23e70-535f-4a26-becc-5f25160e04a9', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43cf110-64cc-4343-a66b-bda966cdb674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:51 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Volume volume-29d23e70-535f-4a26-becc-5f25160e04a9 (29d23e70-535f-4a26-becc-5f25160e04a9): created successfully
Sep 16 11:28:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43cf110-64cc-4343-a66b-bda966cdb674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Flow 'volume_create_manager' (b765963d-eaf5-4a65-bc6a-2eeda901cd77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:51 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f10f1cc6-a44a-481c-8494-97dfc43933dd tempest-AttachVolumeTestJSON-648416907 None] Created volume successfully.
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_8e2unapw" returned: 0 in 1.428s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.836s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_8e2unapw {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:28:52 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Deleted volume successfully.
Sep 16 11:28:52 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Flow 'volume_create_manager' (169debea-547b-4c13-9708-31330b7f9402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ed3d3e-dda0-4453-94f8-65c533070132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bf07082e-32b5-4ec3-aaca-e2bc2ec1478d tempest-VolumesTransfersV355Test-2062775974 None] Lock "cinder-65662b04-f1d5-44a7-86d0-459018584325-delete_volume" released by "delete_volume" :: held 8.188s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2ed3d3e-dda0-4453-94f8-65c533070132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-172759835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35d2914-cf29-4b80-a049-ae4f2f0dd92d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f11fbbb949471eab6ae34fc0ef5d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:52Z,use_quota=True,user_id='24a6f569a7b548779480623fba9f4a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d14b93f-4982-481c-a374-5589c4365c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d14b93f-4982-481c-a374-5589c4365c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccb0519-c8c4-4f33-bdd5-d263c4148215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccb0519-c8c4-4f33-bdd5-d263c4148215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35d2914-cf29-4b80-a049-ae4f2f0dd92d', 'volume_name': 'volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29f697d-e7eb-4bc7-8d1f-44ca0cb54b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29f697d-e7eb-4bc7-8d1f-44ca0cb54b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34059ec-744e-4291-98a1-76781f070f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:52 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Volume f35d2914-cf29-4b80-a049-ae4f2f0dd92d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d', 'volume_size': 1}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-172759835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35d2914-cf29-4b80-a049-ae4f2f0dd92d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f11fbbb949471eab6ae34fc0ef5d35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:28:52Z,use_quota=True,user_id='24a6f569a7b548779480623fba9f4a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Creating volume f35d2914-cf29-4b80-a049-ae4f2f0dd92d {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:28:52 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_8e2unapw" returned: 1 in 0.760s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_8e2unapw' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[00342f0f-5451-4d56-96be-91fea85b879d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:52 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=51, name=volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:28:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d 1073741824" returned: 0 in 0.438s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d" returned: 0 in 0.100s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] <== create_volume: return (626ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:28:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.643s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD" returned: 0 in 0.607s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:53 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] 13854d1c-3e34-4df3-b2da-8c21cec8f4d0 was qcow2, converting to raw {{(pid=83386) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 16 11:28:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:53 devstack quobyte-client[83411]: System call of process 94816 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:28:53 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=49, name=volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:28:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34059ec-744e-4291-98a1-76781f070f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0456407-ed51-41fe-8470-9c158ac30048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:54 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Volume volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d (f35d2914-cf29-4b80-a049-ae4f2f0dd92d): created successfully
Sep 16 11:28:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0456407-ed51-41fe-8470-9c158ac30048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Flow 'volume_create_manager' (169debea-547b-4c13-9708-31330b7f9402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:54 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-185228bb-0c33-4add-ab13-6c569458fd35 tempest-VolumesTransfersV355Test-1632159967 None] Created volume successfully.
Sep 16 11:28:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" returned: 0 in 1.152s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:54 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_13854d1c-3e34-4df3-b2da-8c21cec8f4d0_0h1c5urjdevstack@QuobyteHD, size 112.00 MB, duration 1.16 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:28:54 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Converted 112.00 MB image at 96.88 MB/s
Sep 16 11:28:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde 1G" returned: 0 in 0.153s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:55 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[036e0f45-09fd-41ad-a711-dc023258d8ea]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" returned: 0 in 0.617s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Acquiring lock "cinder-f35d2914-cf29-4b80-a049-ae4f2f0dd92d-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" returned: 1 in 0.854s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Downloaded image 13854d1c-3e34-4df3-b2da-8c21cec8f4d0 ((None, None)) to volume cf64b3d6-4ea7-4b0d-a855-db51c17c1dde successfully. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Temporary image 13854d1c-3e34-4df3-b2da-8c21cec8f4d0 for user 62a93701170146ebaecbf4ed322a2089 is deleted. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Marking volume cf64b3d6-4ea7-4b0d-a855-db51c17c1dde as bootable. {{(pid=83386) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Lock "cinder-f35d2914-cf29-4b80-a049-ae4f2f0dd92d-delete_volume" acquired by "delete_volume" :: waited 0.382s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-894449d5-b6ea-49eb-a7be-342a781ce89b req-727b13de-ec94-4416-a626-b048b4c32ad4 tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-894449d5-b6ea-49eb-a7be-342a781ce89b req-727b13de-ec94-4416-a626-b048b4c32ad4 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d58d516-817c-4057-82ca-c43ea393aafd]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-894449d5-b6ea-49eb-a7be-342a781ce89b req-727b13de-ec94-4416-a626-b048b4c32ad4 tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-29d23e70-535f-4a26-becc-5f25160e04a9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Copying metadata from image 13854d1c-3e34-4df3-b2da-8c21cec8f4d0 to cf64b3d6-4ea7-4b0d-a855-db51c17c1dde. {{(pid=83386) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 11:28:56 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Creating volume glance metadata for volume cf64b3d6-4ea7-4b0d-a855-db51c17c1dde backed by image 13854d1c-3e34-4df3-b2da-8c21cec8f4d0 with: {'image_id': '13854d1c-3e34-4df3-b2da-8c21cec8f4d0', 'image_name': 'tempest-scenario-img--1079825960', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83386) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 11:28:57 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Acquiring lock "cinder-quobyte-f35d2914-cf29-4b80-a049-ae4f2f0dd92d" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Lock "cinder-quobyte-f35d2914-cf29-4b80-a049-ae4f2f0dd92d" acquired by "delete_volume" :: waited 0.069s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[08335ea3-7278-4396-80f2-37a57a70c282]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-894449d5-b6ea-49eb-a7be-342a781ce89b req-727b13de-ec94-4416-a626-b048b4c32ad4 tempest-AttachVolumeTestJSON-648416907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-29d23e70-535f-4a26-becc-5f25160e04a9" returned: 0 in 0.847s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-894449d5-b6ea-49eb-a7be-342a781ce89b req-727b13de-ec94-4416-a626-b048b4c32ad4 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.903s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-894449d5-b6ea-49eb-a7be-342a781ce89b req-727b13de-ec94-4416-a626-b048b4c32ad4 tempest-AttachVolumeTestJSON-648416907 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-29d23e70-535f-4a26-becc-5f25160e04a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ba41e5a-5d85-41eb-b5a7-b4505015f3e0', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:28:57 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-894449d5-b6ea-49eb-a7be-342a781ce89b req-727b13de-ec94-4416-a626-b048b4c32ad4 tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9076cfb9-3b40-4cd5-908e-ee771fc866db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde', 'volume_size': 1, 'image_id': '13854d1c-3e34-4df3-b2da-8c21cec8f4d0', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--1079825960', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f8159de10e94669b9176fc17de59da0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '13854d1c-3e34-4df3-b2da-8c21cec8f4d0', 'created_at': datetime.datetime(2025, 9, 16, 9, 28, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 9, 28, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13854d1c-3e34-4df3-b2da-8c21cec8f4d0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8933b35b0>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2563b5-a6ca-47ef-8d8e-d19b02ad2c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d" returned: 0 in 0.627s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:58 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde (cf64b3d6-4ea7-4b0d-a855-db51c17c1dde): created successfully
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2563b5-a6ca-47ef-8d8e-d19b02ad2c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Flow 'volume_create_manager' (8496015a-9ea1-418a-8f36-247aeed6a54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f35d2914-cf29-4b80-a049-ae4f2f0dd92d" returned: 0 in 0.401s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:58 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-9cf712c5-d3e2-495a-9e7d-6a02dccf3664 tempest-TestInstancesWithCinderVolumes-1461621892 None] Created volume successfully.
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Lock "cinder-quobyte-f35d2914-cf29-4b80-a049-ae4f2f0dd92d" released by "delete_volume" :: held 1.158s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:28:58 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-894449d5-b6ea-49eb-a7be-342a781ce89b req-727b13de-ec94-4416-a626-b048b4c32ad4 tempest-AttachVolumeTestJSON-648416907 None] attachment_update completed successfully.
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Created reservations ['4237d068-5148-467b-b6c1-2bcadb82fb35', '2b0c09f8-5dfe-4ccd-aaa4-998931422657', 'ab6be754-e6c9-499a-ae0b-9a2209676dab', '62ef0490-9dcc-446e-a9f2-baac8cb157a6'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.172s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:28:58 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:28:59 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Deleted volume successfully.
Sep 16 11:28:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-80173a84-e3aa-4c50-b803-7ed153813eaf tempest-VolumesTransfersV355Test-2062775974 None] Lock "cinder-f35d2914-cf29-4b80-a049-ae4f2f0dd92d-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:29:06 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Flow 'volume_create_manager' (4c17205b-c6c8-4c49-89b0-cf91abfcf79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1388501-f257-4f37-86ff-e3ac4af86996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1388501-f257-4f37-86ff-e3ac4af86996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-706030655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99479e6f-a64b-4749-8346-2ecc28b79849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f68006c70c4c1ca3ea4b773680aeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:29:07Z,use_quota=True,user_id='c1dfb6ce0ac947bcbd9ef87c7aebcbc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72d5eea-21ea-4793-941b-113560ccb684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e72d5eea-21ea-4793-941b-113560ccb684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb83d53-35ae-40f0-b7b7-8bbe278172f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eb83d53-35ae-40f0-b7b7-8bbe278172f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99479e6f-a64b-4749-8346-2ecc28b79849', 'volume_name': 'volume-99479e6f-a64b-4749-8346-2ecc28b79849', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53abfc80-8d00-4b55-9cdf-d9bb2935d32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53abfc80-8d00-4b55-9cdf-d9bb2935d32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b196e659-59d2-47cb-a035-594aa36c7f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:06 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Volume 99479e6f-a64b-4749-8346-2ecc28b79849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99479e6f-a64b-4749-8346-2ecc28b79849', 'volume_size': 1}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-706030655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99479e6f-a64b-4749-8346-2ecc28b79849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f68006c70c4c1ca3ea4b773680aeb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:29:07Z,use_quota=True,user_id='c1dfb6ce0ac947bcbd9ef87c7aebcbc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Creating volume 99479e6f-a64b-4749-8346-2ecc28b79849 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:29:07 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:29:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:07 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:29:07 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:29:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-99479e6f-a64b-4749-8346-2ecc28b79849 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:07 devstack quobyte-client[83411]: System call of process 95247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:29:07 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=52, name=volume-99479e6f-a64b-4749-8346-2ecc28b79849, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:29:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-99479e6f-a64b-4749-8346-2ecc28b79849 1073741824" returned: 0 in 0.490s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-99479e6f-a64b-4749-8346-2ecc28b79849 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-99479e6f-a64b-4749-8346-2ecc28b79849" returned: 0 in 0.242s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:07 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] <== create_volume: return (846ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:29:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b196e659-59d2-47cb-a035-594aa36c7f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99479e6f-a64b-4749-8346-2ecc28b79849', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54acc6e6-4995-492c-8641-8c1820e47957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:08 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Volume volume-99479e6f-a64b-4749-8346-2ecc28b79849 (99479e6f-a64b-4749-8346-2ecc28b79849): created successfully
Sep 16 11:29:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54acc6e6-4995-492c-8641-8c1820e47957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Flow 'volume_create_manager' (4c17205b-c6c8-4c49-89b0-cf91abfcf79e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:29:08 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-7f439de9-51ef-442a-9d2c-054fb311a037 tempest-AttachVolumeTestJSON-648416907 None] Created volume successfully.
Sep 16 11:29:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:10 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca6bbc7-045f-4869-a381-31b1042d8103]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:29:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" returned: 0 in 0.579s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" returned: 1 in 0.579s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.408s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fd67f64-8bf6-411f-a3cf-461a87714270', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:29:12 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:12 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-ff92defe-94c7-427d-aabf-57c967848c94 req-66df5a6d-b906-4c45-97ab-1bdcde51fd39 tempest-TestInstancesWithCinderVolumes-1461621892 None] attachment_update completed successfully.
Sep 16 11:29:12 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Flow 'volume_create_manager' (da2a8480-3f9c-405f-9fc1-ca1b18a4535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0138bd65-aefb-4b6a-aecf-227116415f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0138bd65-aefb-4b6a-aecf-227116415f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-110637558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2f12a3-868b-458c-8cbd-7f7a6976021d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d4283948a24d73834fd3cc94df92b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:29:13Z,use_quota=True,user_id='56e8d799387e43b1a17479a008eeb1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c75486-477d-4339-80b1-48354428c80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c75486-477d-4339-80b1-48354428c80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e81abcd-2bea-49f0-a941-dd221d747a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e81abcd-2bea-49f0-a941-dd221d747a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de2f12a3-868b-458c-8cbd-7f7a6976021d', 'volume_name': 'volume-de2f12a3-868b-458c-8cbd-7f7a6976021d', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90236c4c-4906-4830-b30a-5461013f5311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90236c4c-4906-4830-b30a-5461013f5311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf698cd4-e447-4f83-9df3-5f3580a2f016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:12 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Volume de2f12a3-868b-458c-8cbd-7f7a6976021d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de2f12a3-868b-458c-8cbd-7f7a6976021d', 'volume_size': 1}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-110637558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2f12a3-868b-458c-8cbd-7f7a6976021d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d4283948a24d73834fd3cc94df92b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:29:13Z,use_quota=True,user_id='56e8d799387e43b1a17479a008eeb1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Creating volume de2f12a3-868b-458c-8cbd-7f7a6976021d {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:29:12 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:29:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-de2f12a3-868b-458c-8cbd-7f7a6976021d 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:13 devstack quobyte-client[83411]: System call of process 95272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:29:13 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=53, name=volume-de2f12a3-868b-458c-8cbd-7f7a6976021d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:29:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-de2f12a3-868b-458c-8cbd-7f7a6976021d 1073741824" returned: 0 in 0.465s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-de2f12a3-868b-458c-8cbd-7f7a6976021d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-de2f12a3-868b-458c-8cbd-7f7a6976021d" returned: 0 in 0.300s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] <== create_volume: return (871ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:29:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf698cd4-e447-4f83-9df3-5f3580a2f016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2f12a3-868b-458c-8cbd-7f7a6976021d', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5ea25e-ddc1-4540-a715-178352f3d767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-b48fc19d-8cae-420d-963d-c1796bf6a6e9 req-a3fca294-0b2e-43db-bd2e-b781c1865360 tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-b48fc19d-8cae-420d-963d-c1796bf6a6e9 req-a3fca294-0b2e-43db-bd2e-b781c1865360 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:14 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Volume volume-de2f12a3-868b-458c-8cbd-7f7a6976021d (de2f12a3-868b-458c-8cbd-7f7a6976021d): created successfully
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5ea25e-ddc1-4540-a715-178352f3d767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Flow 'volume_create_manager' (da2a8480-3f9c-405f-9fc1-ca1b18a4535d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbb4b7f-8441-4453-8cf7-3179f0d32d4d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-b48fc19d-8cae-420d-963d-c1796bf6a6e9 req-a3fca294-0b2e-43db-bd2e-b781c1865360 tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-99479e6f-a64b-4749-8346-2ecc28b79849 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5d09733a-b8a3-4798-aa30-e18d3cbd1ea0 tempest-VolumesTransfersV357Test-937589185 None] Created volume successfully.
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-b48fc19d-8cae-420d-963d-c1796bf6a6e9 req-a3fca294-0b2e-43db-bd2e-b781c1865360 tempest-AttachVolumeTestJSON-648416907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-99479e6f-a64b-4749-8346-2ecc28b79849" returned: 0 in 0.523s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-b48fc19d-8cae-420d-963d-c1796bf6a6e9 req-a3fca294-0b2e-43db-bd2e-b781c1865360 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.611s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-b48fc19d-8cae-420d-963d-c1796bf6a6e9 req-a3fca294-0b2e-43db-bd2e-b781c1865360 tempest-AttachVolumeTestJSON-648416907 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-99479e6f-a64b-4749-8346-2ecc28b79849', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8add6136-c306-4279-a244-270f9e2cc132', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:29:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b48fc19d-8cae-420d-963d-c1796bf6a6e9 req-a3fca294-0b2e-43db-bd2e-b781c1865360 tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:15 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-b48fc19d-8cae-420d-963d-c1796bf6a6e9 req-a3fca294-0b2e-43db-bd2e-b781c1865360 tempest-AttachVolumeTestJSON-648416907 None] attachment_update completed successfully.
Sep 16 11:29:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2c73aaba-45b7-4b10-adeb-4297a9a1efb5 tempest-VolumesTransfersV357Test-1871452433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:15 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2c73aaba-45b7-4b10-adeb-4297a9a1efb5 tempest-VolumesTransfersV357Test-1871452433 None] Transfer volume completed successfully.
Sep 16 11:29:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Acquiring lock "cinder-de2f12a3-868b-458c-8cbd-7f7a6976021d-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:29:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Lock "cinder-de2f12a3-868b-458c-8cbd-7f7a6976021d-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:29:17 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Acquiring lock "cinder-quobyte-de2f12a3-868b-458c-8cbd-7f7a6976021d" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:29:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Lock "cinder-quobyte-de2f12a3-868b-458c-8cbd-7f7a6976021d" acquired by "delete_volume" :: waited 0.014s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:29:17 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a77f37-b547-431c-8f8e-1b688e554e6d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:29:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-de2f12a3-868b-458c-8cbd-7f7a6976021d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-de2f12a3-868b-458c-8cbd-7f7a6976021d" returned: 0 in 0.439s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-de2f12a3-868b-458c-8cbd-7f7a6976021d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-de2f12a3-868b-458c-8cbd-7f7a6976021d" returned: 0 in 0.117s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Lock "cinder-quobyte-de2f12a3-868b-458c-8cbd-7f7a6976021d" released by "delete_volume" :: held 0.706s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:29:18 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Created reservations ['42b61255-4635-4d81-89d5-38fe5ab42c89', 'a88c4587-d776-4d54-a7eb-3f5304a07449', '242f10f3-8c0b-4a9d-b62f-d0718da221d4', 'b70a660b-fe38-4408-9de7-59848fe1310b'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:29:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:29:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:29:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.174s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:18 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:29:18 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Deleted volume successfully.
Sep 16 11:29:19 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7d2dba5e-d094-4a11-9984-a880b8386472 tempest-VolumesTransfersV357Test-591255343 None] Lock "cinder-de2f12a3-868b-458c-8cbd-7f7a6976021d-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:29:20 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Flow 'volume_create_manager' (6937e116-7b75-4e5b-a945-3fc79566655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e9e7be-9710-45e2-88e4-bf551e9bd4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e9e7be-9710-45e2-88e4-bf551e9bd4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-314708077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459a25bd-3bb7-44dc-b538-7c7b6ff98ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d4283948a24d73834fd3cc94df92b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:29:20Z,use_quota=True,user_id='56e8d799387e43b1a17479a008eeb1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f66a50f-f5f3-48fd-8ebb-f1e0500eae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f66a50f-f5f3-48fd-8ebb-f1e0500eae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1356b193-08e4-4b03-8320-b8260ccc9dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1356b193-08e4-4b03-8320-b8260ccc9dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459a25bd-3bb7-44dc-b538-7c7b6ff98ead', 'volume_name': 'volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240d3014-77a4-461b-91d5-6af623646dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240d3014-77a4-461b-91d5-6af623646dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df770259-60e0-499a-b8b7-eceadc24fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:20 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Volume 459a25bd-3bb7-44dc-b538-7c7b6ff98ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead', 'volume_size': 1}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-314708077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459a25bd-3bb7-44dc-b538-7c7b6ff98ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48d4283948a24d73834fd3cc94df92b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:29:20Z,use_quota=True,user_id='56e8d799387e43b1a17479a008eeb1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Creating volume 459a25bd-3bb7-44dc-b538-7c7b6ff98ead {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:29:20 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:29:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:20 devstack quobyte-client[83411]: System call of process 95350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:29:20 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=54, name=volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:29:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead 1073741824" returned: 0 in 0.858s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead" returned: 0 in 0.231s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] <== create_volume: return (1304ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:29:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:22 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=83,cinder:SELECT=60,cinder:INSERT=16,cinder:DELETE=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:29:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df770259-60e0-499a-b8b7-eceadc24fc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11ad7c0-6caf-451a-b837-60944c37fa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:23 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=67,cinder:UPDATE=59,cinder:DELETE=10,cinder:INSERT=17 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:29:23 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Volume volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead (459a25bd-3bb7-44dc-b538-7c7b6ff98ead): created successfully
Sep 16 11:29:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11ad7c0-6caf-451a-b837-60944c37fa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Flow 'volume_create_manager' (6937e116-7b75-4e5b-a945-3fc79566655f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:29:23 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-41a42d51-7ded-421c-b2ad-51b6a1042aee tempest-VolumesTransfersV357Test-937589185 None] Created volume successfully.
Sep 16 11:29:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Acquiring lock "cinder-459a25bd-3bb7-44dc-b538-7c7b6ff98ead-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:29:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Lock "cinder-459a25bd-3bb7-44dc-b538-7c7b6ff98ead-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:29:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Acquiring lock "cinder-quobyte-459a25bd-3bb7-44dc-b538-7c7b6ff98ead" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:29:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Lock "cinder-quobyte-459a25bd-3bb7-44dc-b538-7c7b6ff98ead" acquired by "delete_volume" :: waited 0.023s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:29:25 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f103d019-356f-4111-a7d2-902c37357feb]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:29:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:29:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:29:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:29:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:25 devstack quobyte-client[83411]: System call of process 95410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:29:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.132s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:29:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead" returned: 0 in 1.099s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-459a25bd-3bb7-44dc-b538-7c7b6ff98ead" returned: 0 in 0.132s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Lock "cinder-quobyte-459a25bd-3bb7-44dc-b538-7c7b6ff98ead" released by "delete_volume" :: held 1.574s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:29:27 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Created reservations ['02cf2ef6-065f-48fd-aa14-13d6ee1e7994', 'dd0fc085-7e87-4fd1-9613-4e0cc885c003', 'ae033f9d-d14e-44c0-91c2-467901ff8b9f', '578fd221-0550-4888-a9fb-d9b16e04ccd4'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:29:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:29:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:29:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.085s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:29:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Deleted volume successfully.
Sep 16 11:29:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-51d4f5c8-3559-4d9d-a7b3-2fff86476868 tempest-VolumesTransfersV357Test-591255343 None] Lock "cinder-459a25bd-3bb7-44dc-b538-7c7b6ff98ead-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:29:37 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=9,cinder:SELECT=6 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:29:37 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=8,cinder:DELETE=2,cinder:SELECT=4,cinder:INSERT=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:29:38 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Flow 'volume_create_manager' (23542518-33ad-4b1c-a415-50a059e23ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c1b259-756d-4ff5-b509-482d8d4d99f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1c1b259-756d-4ff5-b509-482d8d4d99f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1742533914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837ae3ae-5628-4e50-9c78-be718a2ce864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8631f55e9c9145de8b00c741059ab03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:29:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:29:38Z,use_quota=True,user_id='3b51e36d69274108aa1c85fa97be02a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b312ae1-590a-48f6-bedb-76f213395fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b312ae1-590a-48f6-bedb-76f213395fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abb837c-29d2-4975-8e18-e6f6b813d43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abb837c-29d2-4975-8e18-e6f6b813d43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837ae3ae-5628-4e50-9c78-be718a2ce864', 'volume_name': 'volume-837ae3ae-5628-4e50-9c78-be718a2ce864', 'volume_size': 2}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267fe743-5e03-4cde-a607-b54f41be94b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267fe743-5e03-4cde-a607-b54f41be94b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adceb332-4af7-464d-8078-9c0e5bd0de62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:38 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Volume 837ae3ae-5628-4e50-9c78-be718a2ce864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837ae3ae-5628-4e50-9c78-be718a2ce864', 'volume_size': 2}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1742533914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837ae3ae-5628-4e50-9c78-be718a2ce864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8631f55e9c9145de8b00c741059ab03c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:29:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:29:38Z,use_quota=True,user_id='3b51e36d69274108aa1c85fa97be02a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Creating volume 837ae3ae-5628-4e50-9c78-be718a2ce864 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:29:38 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:29:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-837ae3ae-5628-4e50-9c78-be718a2ce864 2147483648 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:39 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=55, name=volume-837ae3ae-5628-4e50-9c78-be718a2ce864, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:29:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-837ae3ae-5628-4e50-9c78-be718a2ce864 2147483648" returned: 0 in 0.692s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-837ae3ae-5628-4e50-9c78-be718a2ce864 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-837ae3ae-5628-4e50-9c78-be718a2ce864" returned: 0 in 0.163s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] <== create_volume: return (966ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:29:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adceb332-4af7-464d-8078-9c0e5bd0de62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837ae3ae-5628-4e50-9c78-be718a2ce864', 'volume_size': 2}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0d7f37-5823-4e90-8199-7fed3705a17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:40 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Volume volume-837ae3ae-5628-4e50-9c78-be718a2ce864 (837ae3ae-5628-4e50-9c78-be718a2ce864): created successfully
Sep 16 11:29:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0d7f37-5823-4e90-8199-7fed3705a17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Flow 'volume_create_manager' (23542518-33ad-4b1c-a415-50a059e23ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:29:40 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-4c823fe7-7396-464c-ada6-32d7403925e4 tempest-VolumesCloneNegativeTest-139089931 None] Created volume successfully.
Sep 16 11:29:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Acquiring lock "cinder-837ae3ae-5628-4e50-9c78-be718a2ce864-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:29:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Lock "cinder-837ae3ae-5628-4e50-9c78-be718a2ce864-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:29:41 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Acquiring lock "cinder-quobyte-837ae3ae-5628-4e50-9c78-be718a2ce864" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:29:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Lock "cinder-quobyte-837ae3ae-5628-4e50-9c78-be718a2ce864" acquired by "delete_volume" :: waited 0.012s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:29:41 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38376ab-8c8a-42b2-84d7-a67ca9df8bc0]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:29:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-837ae3ae-5628-4e50-9c78-be718a2ce864 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-837ae3ae-5628-4e50-9c78-be718a2ce864" returned: 0 in 0.873s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-837ae3ae-5628-4e50-9c78-be718a2ce864 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-837ae3ae-5628-4e50-9c78-be718a2ce864" returned: 0 in 0.389s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:43 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Lock "cinder-quobyte-837ae3ae-5628-4e50-9c78-be718a2ce864" released by "delete_volume" :: held 1.692s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:29:44 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Created reservations ['5514c8bb-6171-47cb-ab7e-f467eba1f419', 'ff0d7a81-23d1-4687-aa38-78bf51a87784', '64ef42c7-d396-48a9-b246-c2c49c376d77', 'f6a0645f-53a4-437f-a82f-02ddcc76aa2b'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:29:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:29:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:29:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.397s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:44 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:29:44 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Deleted volume successfully.
Sep 16 11:29:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4a052723-7e5b-42da-a0c0-80c6dd4ce555 tempest-VolumesCloneNegativeTest-139089931 None] Lock "cinder-837ae3ae-5628-4e50-9c78-be718a2ce864-delete_volume" released by "delete_volume" :: held 4.529s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:29:45 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-e4f12e59-1f60-4042-9ea2-ddcb4010e302 req-9877f96a-6b40-4b0d-b748-ea42eac7e98e tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:46 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-e4f12e59-1f60-4042-9ea2-ddcb4010e302 req-9877f96a-6b40-4b0d-b748-ea42eac7e98e tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-e4f12e59-1f60-4042-9ea2-ddcb4010e302 req-9877f96a-6b40-4b0d-b748-ea42eac7e98e tempest-AttachVolumeTestJSON-648416907 None] Terminate volume connection completed successfully.
Sep 16 11:29:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-e4f12e59-1f60-4042-9ea2-ddcb4010e302 req-9877f96a-6b40-4b0d-b748-ea42eac7e98e tempest-AttachVolumeTestJSON-648416907 None] Deleting attachment 4ba41e5a-5d85-41eb-b5a7-b4505015f3e0. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:29:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Flow 'volume_create_manager' (a53e2947-fbf3-4fb7-99d3-0dab11086ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f79af57-156c-4547-9b98-991640831a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f79af57-156c-4547-9b98-991640831a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1273780839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1f5306-228a-44ed-978c-794a2f7356a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='488cd955ed324eea80e0e46c20543c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:29:52Z,use_quota=True,user_id='aafbe6989841459986633b3282a9ff35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720ae68d-ca7f-4130-a2ac-16d417d497c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720ae68d-ca7f-4130-a2ac-16d417d497c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a0452a-26b1-4233-a3b6-fb70997fc853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a0452a-26b1-4233-a3b6-fb70997fc853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d1f5306-228a-44ed-978c-794a2f7356a5', 'volume_name': 'volume-9d1f5306-228a-44ed-978c-794a2f7356a5', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8933c9450>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae54624-d6d8-4c92-a240-b36f3af3d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae54624-d6d8-4c92-a240-b36f3af3d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d806c4-433e-474d-a607-b936d9fc8774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:29:52 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Volume 9d1f5306-228a-44ed-978c-794a2f7356a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d1f5306-228a-44ed-978c-794a2f7356a5', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8933c9450>}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Cloning 9d1f5306-228a-44ed-978c-794a2f7356a5 from image ae172bdc-0a7f-403f-a999-85b28d841ddd  at location (None, None). {{(pid=83386) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 16 11:29:52 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 16 11:29:52 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 11:29:53 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cc857e-212c-4f27-a156-4ce6c261e358]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:29:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:53 devstack sudo[95492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD
Sep 16 11:29:53 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:29:55 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root
Sep 16 11:29:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD" returned: 0 in 2.219s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:55 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Temporary image ae172bdc-0a7f-403f-a999-85b28d841ddd is fetched for user aafbe6989841459986633b3282a9ff35. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 16 11:29:55 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2c999c-20a3-49c2-8b01-52f2d6d11f21]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:29:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:56 devstack sudo[95497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD
Sep 16 11:29:56 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:29:57 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root
Sep 16 11:29:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD" returned: 0 in 2.386s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1273780839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1f5306-228a-44ed-978c-794a2f7356a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='488cd955ed324eea80e0e46c20543c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:29:52Z,use_quota=True,user_id='aafbe6989841459986633b3282a9ff35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Creating volume 9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:29:58 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:58 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=56, name=volume-9d1f5306-228a-44ed-978c-794a2f7356a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 1073741824" returned: 0 in 0.444s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5" returned: 0 in 0.090s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] <== create_volume: return (631ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:29:58 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Attempting download of ae172bdc-0a7f-403f-a999-85b28d841ddd ((None, None)) to volume 9d1f5306-228a-44ed-978c-794a2f7356a5. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 16 11:29:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[db585863-4438-4beb-9758-c2415b5789a2]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:29:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_yx3_c1rj {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_yx3_c1rj" returned: 0 in 0.414s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_yx3_c1rj {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:29:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_yx3_c1rj" returned: 1 in 0.385s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:29:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_yx3_c1rj' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:29:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[84396f9b-c972-48f6-8689-d5f3e288a26c]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:29:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:00 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] ae172bdc-0a7f-403f-a999-85b28d841ddd was qcow2, converting to raw {{(pid=83386) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 16 11:30:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:00 devstack quobyte-client[83411]: System call of process 95529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:30:00 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=56, name=volume-9d1f5306-228a-44ed-978c-794a2f7356a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:30:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5" returned: 0 in 1.237s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:01 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_g9_otzksdevstack@QuobyteHD, size 112.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:30:01 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Converted 112.00 MB image at 88.71 MB/s
Sep 16 11:30:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 1G" returned: 0 in 0.148s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:02 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[47808b41-5985-43f1-8bd2-3abadd30d66b]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5" returned: 0 in 0.392s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5" returned: 1 in 0.396s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:30:02 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Downloaded image ae172bdc-0a7f-403f-a999-85b28d841ddd ((None, None)) to volume 9d1f5306-228a-44ed-978c-794a2f7356a5 successfully. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 16 11:30:03 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Temporary image ae172bdc-0a7f-403f-a999-85b28d841ddd for user aafbe6989841459986633b3282a9ff35 is deleted. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 16 11:30:03 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Marking volume 9d1f5306-228a-44ed-978c-794a2f7356a5 as bootable. {{(pid=83386) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 16 11:30:03 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Copying metadata from image ae172bdc-0a7f-403f-a999-85b28d841ddd to 9d1f5306-228a-44ed-978c-794a2f7356a5. {{(pid=83386) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 11:30:03 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Creating volume glance metadata for volume 9d1f5306-228a-44ed-978c-794a2f7356a5 backed by image ae172bdc-0a7f-403f-a999-85b28d841ddd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83386) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 11:30:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09d806c4-433e-474d-a607-b936d9fc8774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1f5306-228a-44ed-978c-794a2f7356a5', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8933c9450>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfadc923-9c7a-47e1-bcf8-5cf2435e3abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:03 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Volume volume-9d1f5306-228a-44ed-978c-794a2f7356a5 (9d1f5306-228a-44ed-978c-794a2f7356a5): created successfully
Sep 16 11:30:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfadc923-9c7a-47e1-bcf8-5cf2435e3abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:03 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Flow 'volume_create_manager' (a53e2947-fbf3-4fb7-99d3-0dab11086ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:03 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-4d66effe-3409-43b5-b1aa-7f9e9a4a0d4a tempest-VolumesExtendTest-1888984248 None] Created volume successfully.
Sep 16 11:30:04 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:04 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48d0d37-efc8-434d-a16d-f7d7b1e62c4a]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5" returned: 0 in 0.424s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5" returned: 1 in 0.392s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:30:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 2G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 2G" returned: 0 in 0.132s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.122s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-cf0e4c22-f007-470b-a623-4e5348e9b67e tempest-VolumesExtendTest-1888984248 None] Extend volume completed successfully.
Sep 16 11:30:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Acquiring lock "cinder-9d1f5306-228a-44ed-978c-794a2f7356a5-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Lock "cinder-9d1f5306-228a-44ed-978c-794a2f7356a5-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:07 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Acquiring lock "cinder-quobyte-9d1f5306-228a-44ed-978c-794a2f7356a5" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Lock "cinder-quobyte-9d1f5306-228a-44ed-978c-794a2f7356a5" acquired by "delete_volume" :: waited 0.011s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:07 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[06073d9b-dd98-4eb0-984a-0e479fe6de57]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5" returned: 0 in 0.414s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5" returned: 1 in 0.500s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d1f5306-228a-44ed-978c-794a2f7356a5" returned: 0 in 0.106s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Lock "cinder-quobyte-9d1f5306-228a-44ed-978c-794a2f7356a5" released by "delete_volume" :: held 1.249s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Created reservations ['4db94e02-780c-4cff-a290-e0a7cba9eb65', '49645a6c-191b-4a27-a556-c60467d830a1', '3f0d4ebb-8735-4e6e-af40-7f5fbe6e0f8f', 'f2ee2da0-038f-42ec-94d9-9a2f331375be'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.088s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:08 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:30:09 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Deleted volume successfully.
Sep 16 11:30:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bbf4fe08-6b3b-426b-b0ef-248b468ae9fe tempest-VolumesExtendTest-1888984248 None] Lock "cinder-9d1f5306-228a-44ed-978c-794a2f7356a5-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:10 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:10 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:30:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Flow 'volume_create_manager' (3be874b3-400b-4528-87e2-d57bf6f066f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de18768-af72-4f30-983b-b7e6ac83c7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de18768-af72-4f30-983b-b7e6ac83c7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-640088987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe88ae2-0cbd-400c-b94b-843a2f5cef7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='488cd955ed324eea80e0e46c20543c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:10Z,use_quota=True,user_id='aafbe6989841459986633b3282a9ff35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcf6a60-5daa-43d1-aa96-c13279662628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcf6a60-5daa-43d1-aa96-c13279662628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5c89cc-198b-4ba5-854e-9f2c4753342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5c89cc-198b-4ba5-854e-9f2c4753342d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe88ae2-0cbd-400c-b94b-843a2f5cef7c', 'volume_name': 'volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774f15fe-c37a-49b7-80bb-aee2b46c9deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774f15fe-c37a-49b7-80bb-aee2b46c9deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b73f931-bcd6-4cd9-906d-7f6cb74a926e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:11 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Volume abe88ae2-0cbd-400c-b94b-843a2f5cef7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c', 'volume_size': 1}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-640088987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe88ae2-0cbd-400c-b94b-843a2f5cef7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='488cd955ed324eea80e0e46c20543c47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:10Z,use_quota=True,user_id='aafbe6989841459986633b3282a9ff35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Creating volume abe88ae2-0cbd-400c-b94b-843a2f5cef7c {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:30:11 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:11 devstack quobyte-client[83411]: System call of process 95568 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:30:11 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=57, name=volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:30:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-dd101999-dc7f-4003-9a15-e9aaf0a2364e req-8ef9d67c-0ff5-46f1-8a12-583cfee34315 tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-dd101999-dc7f-4003-9a15-e9aaf0a2364e req-8ef9d67c-0ff5-46f1-8a12-583cfee34315 tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:11 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-dd101999-dc7f-4003-9a15-e9aaf0a2364e req-8ef9d67c-0ff5-46f1-8a12-583cfee34315 tempest-AttachVolumeTestJSON-648416907 None] Terminate volume connection completed successfully.
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-dd101999-dc7f-4003-9a15-e9aaf0a2364e req-8ef9d67c-0ff5-46f1-8a12-583cfee34315 tempest-AttachVolumeTestJSON-648416907 None] Deleting attachment 8add6136-c306-4279-a244-270f9e2cc132. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c 1073741824" returned: 0 in 0.409s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" returned: 0 in 0.099s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] <== create_volume: return (553ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:30:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.565s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b73f931-bcd6-4cd9-906d-7f6cb74a926e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74557dd-55e4-42d7-bdbd-3b1a43fa46e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:12 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Volume volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c (abe88ae2-0cbd-400c-b94b-843a2f5cef7c): created successfully
Sep 16 11:30:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74557dd-55e4-42d7-bdbd-3b1a43fa46e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Flow 'volume_create_manager' (3be874b3-400b-4528-87e2-d57bf6f066f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:12 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8f96d0f8-9e03-4e6d-9a59-2d067e4e0f6d tempest-VolumesExtendTest-1888984248 None] Created volume successfully.
Sep 16 11:30:13 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Creating offline snapshot 34b61110-72da-41a5-b61b-82f70ddc6cf3 of volume abe88ae2-0cbd-400c-b94b-843a2f5cef7c {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:30:13 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6a3c3-1a6c-4f62-a69e-39ece05b8cc6]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" returned: 0 in 0.445s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:14 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=58, name=volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:30:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 1G" returned: 0 in 0.236s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): qemu-img rebase -u -b volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] CMD "qemu-img rebase -u -b volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3" returned: 0 in 0.173s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:30:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3" returned: 0 in 0.095s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:30:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3" returned: 0 in 0.097s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.info" returned: 0 in 0.104s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:30:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.info" returned: 0 in 0.131s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:17 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e8c281fa-5508-4113-ad35-893410d7815c tempest-VolumesExtendTest-1888984248 None] Create snapshot completed successfully
Sep 16 11:30:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fcc29988-2392-447d-9acc-bb5564ef09a6 tempest-VolumesExtendTest-1888984248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fcc29988-2392-447d-9acc-bb5564ef09a6 tempest-VolumesExtendTest-1888984248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fcc29988-2392-447d-9acc-bb5564ef09a6 tempest-VolumesExtendTest-1888984248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:18 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[0762a982-c78a-45da-8f66-24d0117c87f5]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fcc29988-2392-447d-9acc-bb5564ef09a6 tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fcc29988-2392-447d-9acc-bb5564ef09a6 tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" returned: 0 in 1.000s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fcc29988-2392-447d-9acc-bb5564ef09a6 tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 2G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fcc29988-2392-447d-9acc-bb5564ef09a6 tempest-VolumesExtendTest-1888984248 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 2G" returned: 0 in 0.366s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fcc29988-2392-447d-9acc-bb5564ef09a6 tempest-VolumesExtendTest-1888984248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.578s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fcc29988-2392-447d-9acc-bb5564ef09a6 tempest-VolumesExtendTest-1888984248 None] Extend volume completed successfully.
Sep 16 11:30:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Acquiring lock "cinder-34b61110-72da-41a5-b61b-82f70ddc6cf3-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Lock "cinder-34b61110-72da-41a5-b61b-82f70ddc6cf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:21 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Acquiring lock "cinder-quobyte-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Lock "cinder-quobyte-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Acquiring lock "cinder-quobyte-34b61110-72da-41a5-b61b-82f70ddc6cf3" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Lock "cinder-quobyte-34b61110-72da-41a5-b61b-82f70ddc6cf3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Deleting offline snapshot 34b61110-72da-41a5-b61b-82f70ddc6cf3 of volume abe88ae2-0cbd-400c-b94b-843a2f5cef7c {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:30:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] snapshot_file for this snap is: volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:30:21 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae572b9d-33c6-4e8b-a0a5-cdf0d6095296]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3" returned: 0 in 0.884s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:30:22 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29d34d8-85e1-4d11-a828-cf41b9a6f258]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" returned: 0 in 0.488s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3" returned: 0 in 0.370s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c.34b61110-72da-41a5-b61b-82f70ddc6cf3" returned: 0 in 0.119s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Lock "cinder-quobyte-34b61110-72da-41a5-b61b-82f70ddc6cf3" released by "_delete_snapshot" :: held 2.272s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Lock "cinder-quobyte-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" released by "delete_snapshot" :: held 2.314s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:23 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Created reservations ['835b08ff-37e0-44d2-8bbd-bd1b9ab6a706', '17345743-49e3-4c0c-908c-4e2a99565489', '98a1c955-75f7-4571-96a5-a398b899fb42', '86df01c1-7f21-4d97-9115-ee223d186fcd'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:30:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Delete snapshot completed successfully.
Sep 16 11:30:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cafbc242-3e4d-49ce-8eda-4dc8ca066b72 tempest-VolumesExtendTest-1888984248 None] Lock "cinder-34b61110-72da-41a5-b61b-82f70ddc6cf3-delete_snapshot" released by "delete_snapshot" :: held 2.980s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Acquiring lock "cinder-abe88ae2-0cbd-400c-b94b-843a2f5cef7c-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Lock "cinder-abe88ae2-0cbd-400c-b94b-843a2f5cef7c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Acquiring lock "cinder-quobyte-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Lock "cinder-quobyte-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" acquired by "delete_volume" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:24 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[322e5a8d-8258-4f67-aca1-85fdab7039f0]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:25 devstack quobyte-client[83411]: System call of process 95657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" returned: 0 in 0.545s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" returned: 0 in 0.158s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Lock "cinder-quobyte-abe88ae2-0cbd-400c-b94b-843a2f5cef7c" released by "delete_volume" :: held 0.985s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.340s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:30:26 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Created reservations ['d08ec160-3704-4caa-bd01-b2235b086b62', '99349725-5c71-4d0a-9cea-6fef7b19779f', '9927ca01-0f54-4e54-ae00-e6111ca133a1', '999d54aa-22cf-4ef3-9b16-f253c6251999'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:30:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.203s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:30:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Deleted volume successfully.
Sep 16 11:30:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-11574741-d61b-428d-b494-4d8e8969777b tempest-VolumesExtendTest-1888984248 None] Lock "cinder-abe88ae2-0cbd-400c-b94b-843a2f5cef7c-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "cinder-99479e6f-a64b-4749-8346-2ecc28b79849-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-99479e6f-a64b-4749-8346-2ecc28b79849-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:28 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "cinder-quobyte-99479e6f-a64b-4749-8346-2ecc28b79849" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-quobyte-99479e6f-a64b-4749-8346-2ecc28b79849" acquired by "delete_volume" :: waited 0.017s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:29 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa97cd-2303-4263-b384-4c22b6658e42]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-99479e6f-a64b-4749-8346-2ecc28b79849 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-99479e6f-a64b-4749-8346-2ecc28b79849" returned: 0 in 0.636s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-99479e6f-a64b-4749-8346-2ecc28b79849 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-99479e6f-a64b-4749-8346-2ecc28b79849" returned: 0 in 0.187s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-quobyte-99479e6f-a64b-4749-8346-2ecc28b79849" released by "delete_volume" :: held 1.038s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:30 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Created reservations ['fe06d4a8-74d8-4a6b-96eb-6b32023f1c78', '534f8911-1ad3-4d86-b498-f87d08c4d4be', 'ea0159b5-0a9c-4e5b-afca-7337a31caa95', '64141cc3-cc08-438f-a890-4ea6f447b2e3'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:30:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.152s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:30 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:30:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Deleted volume successfully.
Sep 16 11:30:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "cinder-29d23e70-535f-4a26-becc-5f25160e04a9-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-0038d878-3ff8-4550-9695-bb6ed975a579 tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-99479e6f-a64b-4749-8346-2ecc28b79849-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-29d23e70-535f-4a26-becc-5f25160e04a9-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:31 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "cinder-quobyte-29d23e70-535f-4a26-becc-5f25160e04a9" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-quobyte-29d23e70-535f-4a26-becc-5f25160e04a9" acquired by "delete_volume" :: waited 0.021s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:31 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[999df3df-26ec-4fa4-a40a-1d9f61b27753]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-29d23e70-535f-4a26-becc-5f25160e04a9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-29d23e70-535f-4a26-becc-5f25160e04a9" returned: 0 in 0.617s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-29d23e70-535f-4a26-becc-5f25160e04a9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-29d23e70-535f-4a26-becc-5f25160e04a9" returned: 0 in 0.265s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:32 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Flow 'volume_create_manager' (8a50e609-7fcf-485b-955b-0932d61aa743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad516206-1bea-4eb7-ae01-f0fafce2ab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-quobyte-29d23e70-535f-4a26-becc-5f25160e04a9" released by "delete_volume" :: held 1.363s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad516206-1bea-4eb7-ae01-f0fafce2ab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1596048745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4248fc8-75af-42fc-b920-397eea6649f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5ef11780cc463eab0a06e825002c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:32Z,use_quota=True,user_id='197f15bdc39b4552af04670d95174315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93ecb3e-d215-4ffb-91f9-be6de42c8797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93ecb3e-d215-4ffb-91f9-be6de42c8797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e5fb33-15a4-47db-8b2a-36cd31f9b4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e5fb33-15a4-47db-8b2a-36cd31f9b4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4248fc8-75af-42fc-b920-397eea6649f5', 'volume_name': 'volume-e4248fc8-75af-42fc-b920-397eea6649f5', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4eeaf8-1912-4d77-b6fe-0e758d30e6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4eeaf8-1912-4d77-b6fe-0e758d30e6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19599ddb-fcbf-48a4-b111-abf77f8d3e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:32 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Volume e4248fc8-75af-42fc-b920-397eea6649f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4248fc8-75af-42fc-b920-397eea6649f5', 'volume_size': 1}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1596048745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4248fc8-75af-42fc-b920-397eea6649f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5ef11780cc463eab0a06e825002c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:32Z,use_quota=True,user_id='197f15bdc39b4552af04670d95174315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Creating volume e4248fc8-75af-42fc-b920-397eea6649f5 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:30:33 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4248fc8-75af-42fc-b920-397eea6649f5 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:33 devstack quobyte-client[83411]: System call of process 95676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:30:33 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=60, name=volume-e4248fc8-75af-42fc-b920-397eea6649f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4248fc8-75af-42fc-b920-397eea6649f5 1073741824" returned: 0 in 0.487s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4248fc8-75af-42fc-b920-397eea6649f5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Created reservations ['9bff8d86-8623-4531-ab4e-6d1402904bf2', '18a59dda-c21d-4f55-8b5b-bc082b696e1b', '1403957f-6398-4e05-98c1-48503d2f0a13', '895b8669-ef82-4cf3-b89a-d824853e9eaf'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4248fc8-75af-42fc-b920-397eea6649f5" returned: 0 in 0.369s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] <== create_volume: return (918ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:30:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19599ddb-fcbf-48a4-b111-abf77f8d3e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4248fc8-75af-42fc-b920-397eea6649f5', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f01eff-1c12-4721-8d77-e8203dd53566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:34 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Volume volume-e4248fc8-75af-42fc-b920-397eea6649f5 (e4248fc8-75af-42fc-b920-397eea6649f5): created successfully
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f01eff-1c12-4721-8d77-e8203dd53566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Flow 'volume_create_manager' (8a50e609-7fcf-485b-955b-0932d61aa743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-6d2e81cd-e893-40b0-a329-57f1da08d5ec tempest-VolumesListTestJSON-1942301427 None] Created volume successfully.
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.463s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:30:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Deleted volume successfully.
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1ed81195-a52a-4438-b42f-e2dd581c01ad tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-29d23e70-535f-4a26-becc-5f25160e04a9-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "cinder-d88cccef-36fc-4d9f-b797-4f90680bdb66-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-d88cccef-36fc-4d9f-b797-4f90680bdb66-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:35 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "cinder-quobyte-d88cccef-36fc-4d9f-b797-4f90680bdb66" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-quobyte-d88cccef-36fc-4d9f-b797-4f90680bdb66" acquired by "delete_volume" :: waited 0.014s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:35 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Flow 'volume_create_manager' (c40cda2c-3943-4d5f-947c-397de7326bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f61a91-cc5c-4c56-be76-5715c762fed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca87a5-cfb5-4ed7-bb46-18dca92efec9]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d88cccef-36fc-4d9f-b797-4f90680bdb66 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f61a91-cc5c-4c56-be76-5715c762fed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-59965010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1311d6-a983-475a-af19-c44141d4e27f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5ef11780cc463eab0a06e825002c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:35Z,use_quota=True,user_id='197f15bdc39b4552af04670d95174315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09624a1a-ea40-47de-a3d3-f1490127ff70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09624a1a-ea40-47de-a3d3-f1490127ff70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f863ef6-e08f-4dd9-a210-50bd5c5f21b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f863ef6-e08f-4dd9-a210-50bd5c5f21b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1311d6-a983-475a-af19-c44141d4e27f', 'volume_name': 'volume-bd1311d6-a983-475a-af19-c44141d4e27f', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2957a9b6-6228-44cb-9acc-a2ede50c10a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2957a9b6-6228-44cb-9acc-a2ede50c10a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1989ed-31b9-4dfb-8adc-59521e7a45f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:35 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Volume bd1311d6-a983-475a-af19-c44141d4e27f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1311d6-a983-475a-af19-c44141d4e27f', 'volume_size': 1}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-59965010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd1311d6-a983-475a-af19-c44141d4e27f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5ef11780cc463eab0a06e825002c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:35Z,use_quota=True,user_id='197f15bdc39b4552af04670d95174315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Creating volume bd1311d6-a983-475a-af19-c44141d4e27f {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:35 devstack quobyte-client[83411]: System call of process 95681 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:30:35 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:30:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bd1311d6-a983-475a-af19-c44141d4e27f 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d88cccef-36fc-4d9f-b797-4f90680bdb66" returned: 0 in 0.690s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d88cccef-36fc-4d9f-b797-4f90680bdb66 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:36 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=61, name=volume-bd1311d6-a983-475a-af19-c44141d4e27f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:30:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d88cccef-36fc-4d9f-b797-4f90680bdb66" returned: 0 in 0.303s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-quobyte-d88cccef-36fc-4d9f-b797-4f90680bdb66" released by "delete_volume" :: held 1.234s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bd1311d6-a983-475a-af19-c44141d4e27f 1073741824" returned: 0 in 0.708s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bd1311d6-a983-475a-af19-c44141d4e27f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bd1311d6-a983-475a-af19-c44141d4e27f" returned: 0 in 0.327s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] <== create_volume: return (1121ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:30:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Created reservations ['bcc51814-73ff-4b91-b317-fb61df45e5f8', '19cfa500-ff64-4735-bc08-b48a46b3a35f', 'ed04b634-4764-4ef5-b0db-c0c54cabcf06', '8ffccb58-4038-4baa-bf73-ac0e764dd44c'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1989ed-31b9-4dfb-8adc-59521e7a45f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1311d6-a983-475a-af19-c44141d4e27f', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a527b98b-2396-45d0-9d62-c75a673ea0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:37 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Volume volume-bd1311d6-a983-475a-af19-c44141d4e27f (bd1311d6-a983-475a-af19-c44141d4e27f): created successfully
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a527b98b-2396-45d0-9d62-c75a673ea0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Flow 'volume_create_manager' (c40cda2c-3943-4d5f-947c-397de7326bda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ad7d9023-e006-4824-b238-34e1a1153636 tempest-VolumesListTestJSON-1942301427 None] Created volume successfully.
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=59,cinder:UPDATE=70,cinder:INSERT=22,cinder:DELETE=5 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.644s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:37 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:30:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Deleted volume successfully.
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=73,cinder:DELETE=7,cinder:SELECT=49,cinder:INSERT=19 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-758b4881-6097-4d47-93c4-495e552bb35e tempest-AttachVolumeTestJSON-648416907 None] Lock "cinder-d88cccef-36fc-4d9f-b797-4f90680bdb66-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:38 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Flow 'volume_create_manager' (75463fbb-3efb-4e7f-b52f-294bd9ff0885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c74ee6-b441-414e-a974-91fe01232ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c74ee6-b441-414e-a974-91fe01232ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1776144738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efc477e-1631-4a4d-81ba-12b41888c1eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5ef11780cc463eab0a06e825002c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:38Z,use_quota=True,user_id='197f15bdc39b4552af04670d95174315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a284de9a-5268-47cc-aaf2-9c36d7879b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a284de9a-5268-47cc-aaf2-9c36d7879b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32a75f5-b3cd-463c-8f19-0f1825ec4bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32a75f5-b3cd-463c-8f19-0f1825ec4bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1efc477e-1631-4a4d-81ba-12b41888c1eb', 'volume_name': 'volume-1efc477e-1631-4a4d-81ba-12b41888c1eb', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32810128-7344-44d6-a53c-a63872ddd0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32810128-7344-44d6-a53c-a63872ddd0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce118fc1-2967-4e8d-aa40-a2a1637f1ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:38 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Volume 1efc477e-1631-4a4d-81ba-12b41888c1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1efc477e-1631-4a4d-81ba-12b41888c1eb', 'volume_size': 1}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1776144738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efc477e-1631-4a4d-81ba-12b41888c1eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce5ef11780cc463eab0a06e825002c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:38Z,use_quota=True,user_id='197f15bdc39b4552af04670d95174315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Creating volume 1efc477e-1631-4a4d-81ba-12b41888c1eb {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:30:38 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:30:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1efc477e-1631-4a4d-81ba-12b41888c1eb 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:38 devstack quobyte-client[83411]: System call of process 95694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:30:38 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=62, name=volume-1efc477e-1631-4a4d-81ba-12b41888c1eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:30:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1efc477e-1631-4a4d-81ba-12b41888c1eb 1073741824" returned: 0 in 0.403s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1efc477e-1631-4a4d-81ba-12b41888c1eb {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1efc477e-1631-4a4d-81ba-12b41888c1eb" returned: 0 in 0.125s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] <== create_volume: return (859ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:30:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce118fc1-2967-4e8d-aa40-a2a1637f1ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efc477e-1631-4a4d-81ba-12b41888c1eb', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82596a7f-faf7-4357-9a2e-a24e1ff87893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:39 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Volume volume-1efc477e-1631-4a4d-81ba-12b41888c1eb (1efc477e-1631-4a4d-81ba-12b41888c1eb): created successfully
Sep 16 11:30:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82596a7f-faf7-4357-9a2e-a24e1ff87893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Flow 'volume_create_manager' (75463fbb-3efb-4e7f-b52f-294bd9ff0885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:39 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-63d004af-586b-43c4-8b09-b48fa0de1d74 tempest-VolumesListTestJSON-1942301427 None] Created volume successfully.
Sep 16 11:30:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-28036eee-bb8e-412b-a9d8-a9ca71c67b48 req-ad557f3a-60eb-42b0-9db2-040d7fcee708 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-28036eee-bb8e-412b-a9d8-a9ca71c67b48 req-ad557f3a-60eb-42b0-9db2-040d7fcee708 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:45 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29667e5-4b3f-485d-aa34-de40bf2a9840]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-28036eee-bb8e-412b-a9d8-a9ca71c67b48 req-ad557f3a-60eb-42b0-9db2-040d7fcee708 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-28036eee-bb8e-412b-a9d8-a9ca71c67b48 req-ad557f3a-60eb-42b0-9db2-040d7fcee708 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5" returned: 0 in 1.303s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-28036eee-bb8e-412b-a9d8-a9ca71c67b48 req-ad557f3a-60eb-42b0-9db2-040d7fcee708 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.406s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "cinder-1efc477e-1631-4a4d-81ba-12b41888c1eb-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-28036eee-bb8e-412b-a9d8-a9ca71c67b48 req-ad557f3a-60eb-42b0-9db2-040d7fcee708 tempest-TestInstancesWithCinderVolumes-1461621892 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83f03c41-1b59-499b-92c2-efcf409eeb46', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:30:46 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-28036eee-bb8e-412b-a9d8-a9ca71c67b48 req-ad557f3a-60eb-42b0-9db2-040d7fcee708 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-1efc477e-1631-4a4d-81ba-12b41888c1eb-delete_volume" acquired by "delete_volume" :: waited 0.200s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:47 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "cinder-quobyte-1efc477e-1631-4a4d-81ba-12b41888c1eb" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-quobyte-1efc477e-1631-4a4d-81ba-12b41888c1eb" acquired by "delete_volume" :: waited 0.052s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:47 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67db04a-8e88-48e2-b05c-d8911d119ae6]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:47 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-28036eee-bb8e-412b-a9d8-a9ca71c67b48 req-ad557f3a-60eb-42b0-9db2-040d7fcee708 tempest-TestInstancesWithCinderVolumes-1461621892 None] attachment_update completed successfully.
Sep 16 11:30:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1efc477e-1631-4a4d-81ba-12b41888c1eb {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1efc477e-1631-4a4d-81ba-12b41888c1eb" returned: 0 in 0.575s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1efc477e-1631-4a4d-81ba-12b41888c1eb {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1efc477e-1631-4a4d-81ba-12b41888c1eb" returned: 0 in 0.135s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:48 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-quobyte-1efc477e-1631-4a4d-81ba-12b41888c1eb" released by "delete_volume" :: held 1.019s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:48 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Created reservations ['e62ffceb-be76-4bc9-8900-269a622f5517', '0073b10c-ba67-4cf8-a8aa-faee19bb7e55', '50c6c750-9180-45e8-878a-6bae5517a1fe', '1be7aa56-ab2d-468f-91ee-1ed22082992d'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:30:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.217s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:49 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:30:49 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Deleted volume successfully.
Sep 16 11:30:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "cinder-bd1311d6-a983-475a-af19-c44141d4e27f-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-816ad4b5-d7dd-4860-9df3-7075e77da9c4 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-1efc477e-1631-4a4d-81ba-12b41888c1eb-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-bd1311d6-a983-475a-af19-c44141d4e27f-delete_volume" acquired by "delete_volume" :: waited 0.162s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:50 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "cinder-quobyte-bd1311d6-a983-475a-af19-c44141d4e27f" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-quobyte-bd1311d6-a983-475a-af19-c44141d4e27f" acquired by "delete_volume" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:50 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00b45de-6e6f-4399-b655-8617f534de27]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bd1311d6-a983-475a-af19-c44141d4e27f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bd1311d6-a983-475a-af19-c44141d4e27f" returned: 0 in 0.731s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bd1311d6-a983-475a-af19-c44141d4e27f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bd1311d6-a983-475a-af19-c44141d4e27f" returned: 0 in 0.155s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-quobyte-bd1311d6-a983-475a-af19-c44141d4e27f" released by "delete_volume" :: held 1.182s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Created reservations ['beb8c642-1575-4ab1-bad5-17efd753e8a2', '48420962-3ab8-4dff-9c5f-46948ef190cf', 'd2d6860d-39da-439c-a612-fddb5799ac79', 'e7a7a49c-8c3d-4e30-84b0-7a545b7e2814'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.117s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:51 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:30:51 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Deleted volume successfully.
Sep 16 11:30:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "cinder-e4248fc8-75af-42fc-b920-397eea6649f5-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d80cfd12-cc1b-4569-afd7-1dc3e8583188 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-bd1311d6-a983-475a-af19-c44141d4e27f-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-e4248fc8-75af-42fc-b920-397eea6649f5-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:52 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "cinder-quobyte-e4248fc8-75af-42fc-b920-397eea6649f5" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-quobyte-e4248fc8-75af-42fc-b920-397eea6649f5" acquired by "delete_volume" :: waited 0.038s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:52 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe8c251-4d73-4b98-ac5d-68c262d7ad5d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4248fc8-75af-42fc-b920-397eea6649f5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:52 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:52 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:30:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Flow 'volume_create_manager' (f801b367-3ccc-4a5f-a728-4368e416b1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1751427f-b148-49a0-91d2-5d8d37de4937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1751427f-b148-49a0-91d2-5d8d37de4937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1645086129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496debde-d53c-4f72-ab41-463ee92f4dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4fc2dbbdf64b00b78bcecb7448278c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:52Z,use_quota=True,user_id='348c2a1e10494e0a9632e75c32fe2a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bcf63c-02b3-4a34-bb82-03522778a727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bcf63c-02b3-4a34-bb82-03522778a727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9b4a54-2300-47b1-b1fa-61c49a13fa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9b4a54-2300-47b1-b1fa-61c49a13fa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496debde-d53c-4f72-ab41-463ee92f4dbb', 'volume_name': 'volume-496debde-d53c-4f72-ab41-463ee92f4dbb', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0ee506-c1cf-4e93-b43f-10873826b934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0ee506-c1cf-4e93-b43f-10873826b934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b0125c-0701-4d3e-a3e1-3c216041902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:53 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Volume 496debde-d53c-4f72-ab41-463ee92f4dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496debde-d53c-4f72-ab41-463ee92f4dbb', 'volume_size': 1}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1645086129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496debde-d53c-4f72-ab41-463ee92f4dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d4fc2dbbdf64b00b78bcecb7448278c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:52Z,use_quota=True,user_id='348c2a1e10494e0a9632e75c32fe2a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Creating volume 496debde-d53c-4f72-ab41-463ee92f4dbb {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:30:53 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4248fc8-75af-42fc-b920-397eea6649f5" returned: 0 in 0.695s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:53 devstack quobyte-client[83411]: System call of process 95772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4248fc8-75af-42fc-b920-397eea6649f5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:53 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=63, name=volume-496debde-d53c-4f72-ab41-463ee92f4dbb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e4248fc8-75af-42fc-b920-397eea6649f5" returned: 0 in 0.203s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb 1073741824" returned: 0 in 0.498s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-quobyte-e4248fc8-75af-42fc-b920-397eea6649f5" released by "delete_volume" :: held 1.249s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb" returned: 0 in 0.355s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] <== create_volume: return (880ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b0125c-0701-4d3e-a3e1-3c216041902b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496debde-d53c-4f72-ab41-463ee92f4dbb', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ca904e-2919-4fdb-9879-c49111cae33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:54 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Volume volume-496debde-d53c-4f72-ab41-463ee92f4dbb (496debde-d53c-4f72-ab41-463ee92f4dbb): created successfully
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ca904e-2919-4fdb-9879-c49111cae33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Flow 'volume_create_manager' (f801b367-3ccc-4a5f-a728-4368e416b1b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:54 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-492b7030-ec8c-4693-a139-2064898ac323 req-b339c522-c1cf-49bc-bcb9-9809cc5d7ee3 tempest-VolumesSnapshotsTestJSON-11877479 None] Created volume successfully.
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Created reservations ['6ff7402c-d49f-46c4-9ae2-08e3563a687b', '5628c1e8-b635-443f-8138-d2f28ca8cdfc', '1a9182c7-07ff-426d-85b4-12e5f3930ab3', '5f29b1e4-e8d0-458f-838c-e6a27bd86a12'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.150s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:30:54 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Deleted volume successfully.
Sep 16 11:30:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9d9f1f1d-a7d0-4ec9-afa0-abd5797b93e3 tempest-VolumesListTestJSON-1942301427 None] Lock "cinder-e4248fc8-75af-42fc-b920-397eea6649f5-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:30:55 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:30:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:30:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Creating offline snapshot 11f7000a-198c-4b4b-b8a1-59abd6e7e066 of volume 496debde-d53c-4f72-ab41-463ee92f4dbb {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:30:55 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b069d4be-b9d6-4905-852f-7d9c9713133b]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb" returned: 0 in 0.490s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:56 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=64, name=volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066 1G" returned: 0 in 0.280s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): qemu-img rebase -u -b volume-496debde-d53c-4f72-ab41-463ee92f4dbb -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:56 devstack quobyte-client[83411]: System call of process 95790 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:30:56 devstack quobyte-client[83411]: System call of process 95790 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "qemu-img rebase -u -b volume-496debde-d53c-4f72-ab41-463ee92f4dbb -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066" returned: 0 in 0.247s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066" returned: 0 in 0.110s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066" returned: 0 in 0.101s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.info" returned: 0 in 0.103s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:30:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.info" returned: 0 in 0.083s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.779s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:30:58 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-64142492-1ae9-44df-a3cf-cd314ff13da1 req-90f1a169-1248-40cf-bd09-588ec4f0e71d tempest-VolumesSnapshotsTestJSON-11877479 None] Create snapshot completed successfully
Sep 16 11:30:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Acquiring lock "cinder-11f7000a-198c-4b4b-b8a1-59abd6e7e066-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "cinder-11f7000a-198c-4b4b-b8a1-59abd6e7e066-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:58 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Acquiring lock "cinder-quobyte-496debde-d53c-4f72-ab41-463ee92f4dbb" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "cinder-quobyte-496debde-d53c-4f72-ab41-463ee92f4dbb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Acquiring lock "cinder-quobyte-11f7000a-198c-4b4b-b8a1-59abd6e7e066" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:30:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "cinder-quobyte-11f7000a-198c-4b4b-b8a1-59abd6e7e066" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Deleting offline snapshot 11f7000a-198c-4b4b-b8a1-59abd6e7e066 of volume 496debde-d53c-4f72-ab41-463ee92f4dbb {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] snapshot_file for this snap is: volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54b4d7d-bbb1-4b28-9a04-dbddcc2c35a7]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:30:59 devstack quobyte-client[83411]: System call of process 95828 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066" returned: 0 in 0.688s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-496debde-d53c-4f72-ab41-463ee92f4dbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:30:59 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Flow 'volume_create_manager' (f18bca3b-8256-4ce8-ae3b-e9dec3188c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5bd509-1dc1-42d1-b9a1-e80f6aa2f210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc73fe1-7cda-413a-b2ce-d4acefb854b4]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5bd509-1dc1-42d1-b9a1-e80f6aa2f210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1143862238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4497d3f9-8e93-473e-a5f6-61400653111e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796656d9cffe467ba01f34e07c95622f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:59Z,use_quota=True,user_id='4e85ffd6215644af879d7b65baa8f3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052f6f09-4e53-45f0-a898-2f3c81cd9d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052f6f09-4e53-45f0-a898-2f3c81cd9d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3496d0c-a9fb-4a0b-9e4d-9bbd5f16a4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:30:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3496d0c-a9fb-4a0b-9e4d-9bbd5f16a4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4497d3f9-8e93-473e-a5f6-61400653111e', 'volume_name': 'volume-4497d3f9-8e93-473e-a5f6-61400653111e', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66898b23-9960-4585-ac9f-15c35f337beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66898b23-9960-4585-ac9f-15c35f337beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4fafb3-b5df-4ee5-a810-ea374bb731a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:00 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Volume 4497d3f9-8e93-473e-a5f6-61400653111e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4497d3f9-8e93-473e-a5f6-61400653111e', 'volume_size': 1}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1143862238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4497d3f9-8e93-473e-a5f6-61400653111e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796656d9cffe467ba01f34e07c95622f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:30:59Z,use_quota=True,user_id='4e85ffd6215644af879d7b65baa8f3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Creating volume 4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:31:00 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:00 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=66, name=volume-4497d3f9-8e93-473e-a5f6-61400653111e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-5e6fb6c3-74c0-4408-96c9-75dd1c0c5ad1 req-7151d603-d2c2-4cdc-a83b-b3ff6acdf732 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e 1073741824" returned: 0 in 0.766s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e" returned: 0 in 0.130s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] <== create_volume: return (938ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:31:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-5e6fb6c3-74c0-4408-96c9-75dd1c0c5ad1 req-7151d603-d2c2-4cdc-a83b-b3ff6acdf732 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.277s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb" returned: 0 in 0.967s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c581fa5-75fc-4daf-91d8-4b9f3a87a327]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5e6fb6c3-74c0-4408-96c9-75dd1c0c5ad1 req-7151d603-d2c2-4cdc-a83b-b3ff6acdf732 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b9801619-0e4b-453b-aa2b-9591ddba3da2 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:01 devstack quobyte-client[83411]: System call of process 95853 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4fafb3-b5df-4ee5-a810-ea374bb731a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4497d3f9-8e93-473e-a5f6-61400653111e', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211a0ee2-72e3-4d0b-baf2-a01a055a54fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066" returned: 0 in 0.502s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:01 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Volume volume-4497d3f9-8e93-473e-a5f6-61400653111e (4497d3f9-8e93-473e-a5f6-61400653111e): created successfully
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211a0ee2-72e3-4d0b-baf2-a01a055a54fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:01 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Flow 'volume_create_manager' (f18bca3b-8256-4ce8-ae3b-e9dec3188c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5e6fb6c3-74c0-4408-96c9-75dd1c0c5ad1 req-7151d603-d2c2-4cdc-a83b-b3ff6acdf732 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b9801619-0e4b-453b-aa2b-9591ddba3da2" returned: 0 in 0.826s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb.11f7000a-198c-4b4b-b8a1-59abd6e7e066" returned: 0 in 0.389s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-5e6fb6c3-74c0-4408-96c9-75dd1c0c5ad1 req-7151d603-d2c2-4cdc-a83b-b3ff6acdf732 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:02 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-9a122929-c692-48b0-a49b-638d69e56d2f tempest-VolumesSnapshotListTestJSON-457322302 None] Created volume successfully.
Sep 16 11:31:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "cinder-quobyte-11f7000a-198c-4b4b-b8a1-59abd6e7e066" released by "_delete_snapshot" :: held 3.158s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "cinder-quobyte-496debde-d53c-4f72-ab41-463ee92f4dbb" released by "delete_snapshot" :: held 3.218s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-5e6fb6c3-74c0-4408-96c9-75dd1c0c5ad1 req-7151d603-d2c2-4cdc-a83b-b3ff6acdf732 tempest-TestInstancesWithCinderVolumes-1461621892 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-b9801619-0e4b-453b-aa2b-9591ddba3da2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e78b4852-c949-4288-bdbc-5c8961a356af', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:31:02 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-5e6fb6c3-74c0-4408-96c9-75dd1c0c5ad1 req-7151d603-d2c2-4cdc-a83b-b3ff6acdf732 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:02 devstack cinder-volume[83386]: DEBUG cinder.quota [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Created reservations ['c080998c-0c4a-40b6-8fd5-ac75728370c8', 'bf01201f-1b58-4ac8-8249-14e1afaa8e39', '02418f1f-4006-4e7d-86e0-34cfafb22a24', '5a28cfc9-ba5b-4fa2-b4fe-da97a5384332'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:02 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-5e6fb6c3-74c0-4408-96c9-75dd1c0c5ad1 req-7151d603-d2c2-4cdc-a83b-b3ff6acdf732 tempest-TestInstancesWithCinderVolumes-1461621892 None] attachment_update completed successfully.
Sep 16 11:31:02 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Delete snapshot completed successfully.
Sep 16 11:31:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-cf72b951-4157-44c5-a899-a58750124a4d req-f56ac7de-74a7-4bd9-835d-0a0ba2893357 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "cinder-11f7000a-198c-4b4b-b8a1-59abd6e7e066-delete_snapshot" released by "delete_snapshot" :: held 3.589s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:03 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Creating offline snapshot 9161729c-ae7f-4703-8c9d-7f546c8fd8e0 of volume 4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:31:03 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d6107c-89f0-43a9-b42f-0d9d5e9ea26b]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Acquiring lock "cinder-496debde-d53c-4f72-ab41-463ee92f4dbb-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:03 devstack quobyte-client[83411]: System call of process 95860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "cinder-496debde-d53c-4f72-ab41-463ee92f4dbb-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e" returned: 0 in 0.790s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:04 devstack quobyte-client[83411]: System call of process 95868 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:04 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=67, name=volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:04 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Acquiring lock "cinder-quobyte-496debde-d53c-4f72-ab41-463ee92f4dbb" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 1G" returned: 0 in 0.548s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4497d3f9-8e93-473e-a5f6-61400653111e -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "cinder-quobyte-496debde-d53c-4f72-ab41-463ee92f4dbb" acquired by "delete_volume" :: waited 0.206s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:04 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aa0d25-b15b-4ecd-90e5-bfbb65c66d8e]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "qemu-img rebase -u -b volume-4497d3f9-8e93-473e-a5f6-61400653111e -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0" returned: 0 in 0.375s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:04 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:31:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0" returned: 0 in 0.153s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0" returned: 0 in 0.215s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb" returned: 0 in 0.669s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.info" returned: 0 in 0.169s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-496debde-d53c-4f72-ab41-463ee92f4dbb" returned: 0 in 0.180s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "cinder-quobyte-496debde-d53c-4f72-ab41-463ee92f4dbb" released by "delete_volume" :: held 1.103s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.info" returned: 0 in 0.356s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.826s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e51382d9-d3f4-477a-9c4a-e89198f8fa64 tempest-VolumesSnapshotListTestJSON-457322302 None] Create snapshot completed successfully
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG cinder.quota [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Created reservations ['50304c5e-55ae-451f-a7b9-5547744fd8fb', '020c5753-8eeb-4087-9a1a-abfab1b2edee', 'f20ab634-4557-4cec-8769-53894ccc5b91', 'f278fe5b-c429-4023-8ad5-def56c43b08a'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.124s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG cinder.manager [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:31:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Deleted volume successfully.
Sep 16 11:31:06 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-01fa7117-837b-40dc-be04-4aac575c50d5 req-395d25ff-5a04-4793-8e6b-863226d0ad38 tempest-VolumesSnapshotsTestJSON-11877479 None] Lock "cinder-496debde-d53c-4f72-ab41-463ee92f4dbb-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Creating offline snapshot 328ea3db-3bc4-4810-9700-29ec44ca0caa of volume 4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fae6316-c94c-4868-aee7-dc83e36a825d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0" returned: 0 in 0.501s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:07 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4497d3f9-8e93-473e-a5f6-61400653111e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:31:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:07 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=69, name=volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa 1G" returned: 0 in 0.418s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "qemu-img rebase -u -b volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa" returned: 0 in 0.235s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:31:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa" returned: 0 in 0.159s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:31:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa" returned: 0 in 0.111s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.771s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:08 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-09789d68-8c3e-4c71-9308-9061ad9b0514 tempest-VolumesSnapshotListTestJSON-457322302 None] Create snapshot completed successfully
Sep 16 11:31:10 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Creating offline snapshot 302c3378-8e4f-4093-8951-400aabbbc4ea of volume 4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:31:10 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbfb169-907c-401f-9cd4-379b5058e5b5]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa" returned: 0 in 0.560s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4497d3f9-8e93-473e-a5f6-61400653111e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:31:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:11 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=70, name=volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea 1G" returned: 0 in 0.310s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:11 devstack quobyte-client[83411]: System call of process 95914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "qemu-img rebase -u -b volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea" returned: 0 in 0.523s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:31:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:11 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Flow 'volume_create_manager' (2b84dc6c-e76d-4e1a-b128-e0a2c0598c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a906519-45bf-42e2-a112-f93b7d3d8838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea" returned: 0 in 0.414s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a906519-45bf-42e2-a112-f93b7d3d8838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1682995940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10c2628-4bf5-447a-b9bc-48f0171776c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='997d6f06814e4a32a9fcacf3b53954ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:11Z,use_quota=True,user_id='a726e7f724804baea9aab0d159d10460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7267a337-98b9-4046-99c6-2570ad452a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7267a337-98b9-4046-99c6-2570ad452a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60e4775-27a1-44e1-b538-3f2253d37df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60e4775-27a1-44e1-b538-3f2253d37df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b10c2628-4bf5-447a-b9bc-48f0171776c6', 'volume_name': 'volume-b10c2628-4bf5-447a-b9bc-48f0171776c6', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d2cc70-15eb-4c8d-9452-4f7b83cd1739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d2cc70-15eb-4c8d-9452-4f7b83cd1739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84586824-5a83-46fb-ac5d-6e3616348a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:12 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Volume b10c2628-4bf5-447a-b9bc-48f0171776c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b10c2628-4bf5-447a-b9bc-48f0171776c6', 'volume_size': 1}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea" returned: 0 in 0.337s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.167s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1682995940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10c2628-4bf5-447a-b9bc-48f0171776c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='997d6f06814e4a32a9fcacf3b53954ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:11Z,use_quota=True,user_id='a726e7f724804baea9aab0d159d10460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Creating volume b10c2628-4bf5-447a-b9bc-48f0171776c6 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:31:12 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:31:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b10c2628-4bf5-447a-b9bc-48f0171776c6 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:12 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=71, name=volume-b10c2628-4bf5-447a-b9bc-48f0171776c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:13 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3e8be204-a8d9-4867-8a16-c8bf6e1cb001 tempest-VolumesSnapshotListTestJSON-457322302 None] Create snapshot completed successfully
Sep 16 11:31:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b10c2628-4bf5-447a-b9bc-48f0171776c6 1073741824" returned: 0 in 0.422s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b10c2628-4bf5-447a-b9bc-48f0171776c6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b10c2628-4bf5-447a-b9bc-48f0171776c6" returned: 0 in 0.250s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] <== create_volume: return (731ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:31:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84586824-5a83-46fb-ac5d-6e3616348a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b10c2628-4bf5-447a-b9bc-48f0171776c6', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee6c1ad-2691-4687-b675-5a50a93cf7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:13 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Volume volume-b10c2628-4bf5-447a-b9bc-48f0171776c6 (b10c2628-4bf5-447a-b9bc-48f0171776c6): created successfully
Sep 16 11:31:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee6c1ad-2691-4687-b675-5a50a93cf7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Flow 'volume_create_manager' (2b84dc6c-e76d-4e1a-b128-e0a2c0598c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:13 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-6c218499-c85b-4c03-b25d-b00e0e4018bb req-324c016b-c2fe-4e01-b550-5a4aa0566b6d tempest-VolumesGetTestJSON-502663316 None] Created volume successfully.
Sep 16 11:31:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-302c3378-8e4f-4093-8951-400aabbbc4ea-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-302c3378-8e4f-4093-8951-400aabbbc4ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.113s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-quobyte-302c3378-8e4f-4093-8951-400aabbbc4ea" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-302c3378-8e4f-4093-8951-400aabbbc4ea" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Deleting offline snapshot 302c3378-8e4f-4093-8951-400aabbbc4ea of volume 4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] snapshot_file for this snap is: volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c518aca2-3bc6-47b4-977f-cf528c12baad]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Acquiring lock "cinder-b10c2628-4bf5-447a-b9bc-48f0171776c6-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Lock "cinder-b10c2628-4bf5-447a-b9bc-48f0171776c6-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Acquiring lock "cinder-quobyte-b10c2628-4bf5-447a-b9bc-48f0171776c6" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Lock "cinder-quobyte-b10c2628-4bf5-447a-b9bc-48f0171776c6" acquired by "delete_volume" :: waited 0.022s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea" returned: 0 in 0.882s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4497d3f9-8e93-473e-a5f6-61400653111e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:31:16 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b4cb66-acf7-4cc2-9f62-112db06b1409]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:16 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c9397d-8d11-4872-9dc1-59531a8ab4ba]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b10c2628-4bf5-447a-b9bc-48f0171776c6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b10c2628-4bf5-447a-b9bc-48f0171776c6" returned: 0 in 0.530s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b10c2628-4bf5-447a-b9bc-48f0171776c6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa" returned: 0 in 0.654s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4497d3f9-8e93-473e-a5f6-61400653111e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:31:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:16 devstack quobyte-client[83411]: System call of process 95951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b10c2628-4bf5-447a-b9bc-48f0171776c6" returned: 0 in 0.395s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Lock "cinder-quobyte-b10c2628-4bf5-447a-b9bc-48f0171776c6" released by "delete_volume" :: held 1.138s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea" returned: 0 in 0.452s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.302c3378-8e4f-4093-8951-400aabbbc4ea" returned: 0 in 0.234s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-302c3378-8e4f-4093-8951-400aabbbc4ea" released by "_delete_snapshot" :: held 2.502s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" released by "delete_snapshot" :: held 2.567s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG cinder.quota [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Created reservations ['71359caa-4dee-4df6-9d72-4bf55576a743', 'b49ab819-3178-4d9f-b284-bcc609e412be', '44d55bba-4f4b-452a-aa1f-a74e013142cc', '2d303a4c-9199-4f46-937d-d9bb00409ee0'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Created reservations ['af1977a8-4ff1-4d02-af12-1ca53891c425', 'c66f351e-df88-4ab9-8ac5-44fa3bd13045', '5dad0a96-4c01-4792-81a8-79d6361eff84', '795e9543-1350-499d-8afe-42e047801363'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:18 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Delete snapshot completed successfully.
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-328ea3db-3bc4-4810-9700-29ec44ca0caa-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e82ce919-c11f-4e85-a087-d4497ffcf5a2 tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-302c3378-8e4f-4093-8951-400aabbbc4ea-delete_snapshot" released by "delete_snapshot" :: held 3.313s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.483s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.manager [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:31:18 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Deleted volume successfully.
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-328ea3db-3bc4-4810-9700-29ec44ca0caa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.195s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-quobyte-328ea3db-3bc4-4810-9700-29ec44ca0caa" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-328ea3db-3bc4-4810-9700-29ec44ca0caa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Deleting offline snapshot 328ea3db-3bc4-4810-9700-29ec44ca0caa of volume 4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] snapshot_file for this snap is: volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-7144a4a7-e00c-4c4b-970c-a3b2f37dca5d req-97b811a8-773a-48ea-a26b-313b6f61ff5f tempest-VolumesGetTestJSON-502663316 None] Lock "cinder-b10c2628-4bf5-447a-b9bc-48f0171776c6-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[804abae8-9ceb-4cf3-b7b0-4f003d997b86]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa" returned: 0 in 0.580s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4497d3f9-8e93-473e-a5f6-61400653111e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:31:19 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf20139-e10b-41f8-aa93-b1c5efd58800]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0" returned: 0 in 0.416s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4497d3f9-8e93-473e-a5f6-61400653111e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:31:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:19 devstack quobyte-client[83411]: System call of process 95966 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa" returned: 0 in 0.224s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.328ea3db-3bc4-4810-9700-29ec44ca0caa" returned: 0 in 0.159s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-328ea3db-3bc4-4810-9700-29ec44ca0caa" released by "_delete_snapshot" :: held 1.690s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" released by "delete_snapshot" :: held 1.714s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:20 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Created reservations ['24b7e30d-03b2-4029-ae6d-85eccfcc1607', '7ec3ce30-f2df-4ae5-868e-f1c3738f5ab7', '0a53061c-7162-474a-8988-332334b3057b', 'e5a1bbb7-eb4c-4970-b933-a356b2f387f8'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Delete snapshot completed successfully.
Sep 16 11:31:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b0c0ac80-b103-43b0-bad6-809acbda273a tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-328ea3db-3bc4-4810-9700-29ec44ca0caa-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-9161729c-ae7f-4703-8c9d-7f546c8fd8e0-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-9161729c-ae7f-4703-8c9d-7f546c8fd8e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:21 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-quobyte-9161729c-ae7f-4703-8c9d-7f546c8fd8e0" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-9161729c-ae7f-4703-8c9d-7f546c8fd8e0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Deleting offline snapshot 9161729c-ae7f-4703-8c9d-7f546c8fd8e0 of volume 4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:31:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] snapshot_file for this snap is: volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:31:21 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a9fde0-89e7-45d2-b675-215ebf994ceb]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0" returned: 0 in 0.391s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4497d3f9-8e93-473e-a5f6-61400653111e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:31:22 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa459aa7-e6ed-4aed-afbc-5834a7b46ebb]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e" returned: 0 in 0.429s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:22 devstack quobyte-client[83411]: System call of process 95977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:22 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:22 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:31:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Flow 'volume_create_manager' (8a86193c-4bd1-4a5f-b567-251b7eab3f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6477508f-7557-4462-8a94-09367c6a5760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0" returned: 0 in 0.500s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6477508f-7557-4462-8a94-09367c6a5760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2051480360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f1f1bf-4b96-4215-8a70-412d57685681,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28d536a589d4f1b8cc27803d1a5ffa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:21Z,use_quota=True,user_id='bdc654de509b46dea22ccf6e834e8416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b222973-3aba-4f44-b973-e3e8e5740e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b222973-3aba-4f44-b973-e3e8e5740e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bd6e6a-9132-4198-9c28-4bddfd93ff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bd6e6a-9132-4198-9c28-4bddfd93ff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f1f1bf-4b96-4215-8a70-412d57685681', 'volume_name': 'volume-54f1f1bf-4b96-4215-8a70-412d57685681', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c576506-da67-427e-a1ed-b1e3d4e7684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c576506-da67-427e-a1ed-b1e3d4e7684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ed8d5a-98d0-4d84-a3b1-4d48c02e4384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:23 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Volume 54f1f1bf-4b96-4215-8a70-412d57685681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f1f1bf-4b96-4215-8a70-412d57685681', 'volume_size': 1}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2051480360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f1f1bf-4b96-4215-8a70-412d57685681,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28d536a589d4f1b8cc27803d1a5ffa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:21Z,use_quota=True,user_id='bdc654de509b46dea22ccf6e834e8416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Creating volume 54f1f1bf-4b96-4215-8a70-412d57685681 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:31:23 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-54f1f1bf-4b96-4215-8a70-412d57685681 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e.9161729c-ae7f-4703-8c9d-7f546c8fd8e0" returned: 0 in 0.358s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:23 devstack quobyte-client[83411]: System call of process 95981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:23 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=72, name=volume-54f1f1bf-4b96-4215-8a70-412d57685681, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-9161729c-ae7f-4703-8c9d-7f546c8fd8e0" released by "_delete_snapshot" :: held 2.022s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" released by "delete_snapshot" :: held 2.067s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-54f1f1bf-4b96-4215-8a70-412d57685681 1073741824" returned: 0 in 0.498s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-54f1f1bf-4b96-4215-8a70-412d57685681 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-54f1f1bf-4b96-4215-8a70-412d57685681" returned: 0 in 0.245s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] <== create_volume: return (805ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ed8d5a-98d0-4d84-a3b1-4d48c02e4384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f1f1bf-4b96-4215-8a70-412d57685681', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b590ca8-54af-48f7-b758-6fe4d28b0ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:24 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Volume volume-54f1f1bf-4b96-4215-8a70-412d57685681 (54f1f1bf-4b96-4215-8a70-412d57685681): created successfully
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b590ca8-54af-48f7-b758-6fe4d28b0ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Flow 'volume_create_manager' (8a86193c-4bd1-4a5f-b567-251b7eab3f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Created reservations ['6fc4f8ce-0caa-433b-a17d-e923dac6c463', 'fedf7d5b-9d1d-4310-9650-2ee658d42215', '1e9833ff-6c63-421a-a978-ea777a2c4ece', '080b87c2-7f88-439b-96fd-c9685fa03c56'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-574691b9-12a8-418e-94db-c84cff727638 tempest-VolumesTestJSON-452792318 None] Created volume successfully.
Sep 16 11:31:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Delete snapshot completed successfully.
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2d83020e-6920-4b8a-a531-cbd12213f97e tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-9161729c-ae7f-4703-8c9d-7f546c8fd8e0-delete_snapshot" released by "delete_snapshot" :: held 2.881s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-4497d3f9-8e93-473e-a5f6-61400653111e-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-4497d3f9-8e93-473e-a5f6-61400653111e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:25 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" acquired by "delete_volume" :: waited 0.017s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f747e688-e4bb-46ca-aaf7-594eb2c5efee]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e" returned: 0 in 0.434s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4497d3f9-8e93-473e-a5f6-61400653111e" returned: 0 in 0.597s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:26 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Flow 'volume_create_manager' (3e3c2cd8-280f-43bc-834e-54d2426b4fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27edc52e-7ffe-4a57-b525-18c53834b8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-quobyte-4497d3f9-8e93-473e-a5f6-61400653111e" released by "delete_volume" :: held 1.303s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.494s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27edc52e-7ffe-4a57-b525-18c53834b8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1821871526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac26ee9-1847-45e3-bbc2-5b51a025b11b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28d536a589d4f1b8cc27803d1a5ffa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:26Z,use_quota=True,user_id='bdc654de509b46dea22ccf6e834e8416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f53f3b1-c646-46ba-afc0-4d784c9b602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f53f3b1-c646-46ba-afc0-4d784c9b602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888d2d49-0d4b-4a55-a0b0-839f91bee2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888d2d49-0d4b-4a55-a0b0-839f91bee2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac26ee9-1847-45e3-bbc2-5b51a025b11b', 'volume_name': 'volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a5202a-90d0-4f60-a6d9-fcee9fa5625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a5202a-90d0-4f60-a6d9-fcee9fa5625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5a8698-9eab-4b5a-b10f-b1755f7bcac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:26 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Volume 9ac26ee9-1847-45e3-bbc2-5b51a025b11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b', 'volume_size': 1}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1821871526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac26ee9-1847-45e3-bbc2-5b51a025b11b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28d536a589d4f1b8cc27803d1a5ffa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:26Z,use_quota=True,user_id='bdc654de509b46dea22ccf6e834e8416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Creating volume 9ac26ee9-1847-45e3-bbc2-5b51a025b11b {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:31:26 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:26 devstack quobyte-client[83411]: System call of process 95990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:26 devstack quobyte-client[83411]: System call of process 95990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:26 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=73, name=volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b 1073741824" returned: 0 in 0.367s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b" returned: 0 in 0.274s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] <== create_volume: return (694ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5a8698-9eab-4b5a-b10f-b1755f7bcac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e3ba4e-2c7f-4521-be13-66f446fba1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Created reservations ['aa36cd18-3961-4ce1-9fb6-49d0f38cd3eb', 'a47587d7-70be-47c0-a10b-430409e5db36', '15d21c67-8fb3-4b2d-b43b-d5b746744173', '46ba28b0-77b9-44c1-b259-3fb83f2355cc'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:27 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Volume volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b (9ac26ee9-1847-45e3-bbc2-5b51a025b11b): created successfully
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e3ba4e-2c7f-4521-be13-66f446fba1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Flow 'volume_create_manager' (3e3c2cd8-280f-43bc-834e-54d2426b4fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f25638eb-4c65-4d67-b8a1-bfd1e1f452e5 tempest-VolumesTestJSON-452792318 None] Created volume successfully.
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.149s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:31:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Deleted volume successfully.
Sep 16 11:31:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-bdc0aa1b-1b55-4395-b244-af437c376a4f tempest-VolumesSnapshotListTestJSON-457322302 None] Lock "cinder-4497d3f9-8e93-473e-a5f6-61400653111e-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:28 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Flow 'volume_create_manager' (d99f083b-24d9-42c4-b223-50d5838fbe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da51c6fb-b8ea-44ba-b858-969e811e3648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da51c6fb-b8ea-44ba-b858-969e811e3648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-386846463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ce7a75-5638-4d61-8f3c-0bd130fc37e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28d536a589d4f1b8cc27803d1a5ffa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:28Z,use_quota=True,user_id='bdc654de509b46dea22ccf6e834e8416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4129210-87e3-4d00-896e-80f4bf40d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4129210-87e3-4d00-896e-80f4bf40d756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900525c0-7bc4-4b85-a170-cb61d823a5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900525c0-7bc4-4b85-a170-cb61d823a5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ce7a75-5638-4d61-8f3c-0bd130fc37e9', 'volume_name': 'volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06d5676-8b3e-4ebc-8d75-d5978de566fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06d5676-8b3e-4ebc-8d75-d5978de566fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ee5324-71db-464f-8dff-2e9824fe5541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:28 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Volume d1ce7a75-5638-4d61-8f3c-0bd130fc37e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9', 'volume_size': 1}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-386846463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ce7a75-5638-4d61-8f3c-0bd130fc37e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c28d536a589d4f1b8cc27803d1a5ffa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:28Z,use_quota=True,user_id='bdc654de509b46dea22ccf6e834e8416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Creating volume d1ce7a75-5638-4d61-8f3c-0bd130fc37e9 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:31:28 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:31:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:28 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=74, name=volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9 1073741824" returned: 0 in 0.340s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9" returned: 0 in 0.140s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] <== create_volume: return (622ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:31:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.635s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ee5324-71db-464f-8dff-2e9824fe5541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1538f39f-c2da-4521-92bb-3e5f7ee20723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:29 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Volume volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9 (d1ce7a75-5638-4d61-8f3c-0bd130fc37e9): created successfully
Sep 16 11:31:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1538f39f-c2da-4521-92bb-3e5f7ee20723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Flow 'volume_create_manager' (d99f083b-24d9-42c4-b223-50d5838fbe0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:29 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-dc17d397-696e-4283-8c26-47b1fd65f2eb tempest-VolumesTestJSON-452792318 None] Created volume successfully.
Sep 16 11:31:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Acquiring lock "cinder-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Lock "cinder-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:31 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Acquiring lock "cinder-quobyte-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Lock "cinder-quobyte-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9" acquired by "delete_volume" :: waited 0.015s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:31 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[724b78e9-de71-4414-9488-719edaae986e]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9" returned: 0 in 0.570s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:32 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:32 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:31:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Flow 'volume_create_manager' (cd308566-5ac7-49c2-96c5-f4818e4e34da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc060823-f7ed-4825-9b26-20a13adc8be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9" returned: 0 in 0.431s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc060823-f7ed-4825-9b26-20a13adc8be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1690696389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f984c4-a410-4d4b-be80-88b735fbd424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf2af9c47bf4cf48d00ad01a212e30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:32Z,use_quota=True,user_id='f451c059273447938443ca8fccfd959f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c1efc2-865d-4dcd-a982-e0cf0f228ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c1efc2-865d-4dcd-a982-e0cf0f228ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9561ec02-a74a-4a88-ac6e-377643cd9996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9561ec02-a74a-4a88-ac6e-377643cd9996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07f984c4-a410-4d4b-be80-88b735fbd424', 'volume_name': 'volume-07f984c4-a410-4d4b-be80-88b735fbd424', 'volume_size': 2}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab08e96-63df-4e3a-9bb6-9a7ea508f4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab08e96-63df-4e3a-9bb6-9a7ea508f4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e844cc06-dfcb-43b7-ad5a-27ba6bc3358f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:33 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Volume 07f984c4-a410-4d4b-be80-88b735fbd424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07f984c4-a410-4d4b-be80-88b735fbd424', 'volume_size': 2}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1690696389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f984c4-a410-4d4b-be80-88b735fbd424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf2af9c47bf4cf48d00ad01a212e30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:32Z,use_quota=True,user_id='f451c059273447938443ca8fccfd959f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Creating volume 07f984c4-a410-4d4b-be80-88b735fbd424 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:31:33 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424 2147483648 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:33 devstack quobyte-client[83411]: System call of process 96004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:33 devstack quobyte-client[83411]: System call of process 96004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:33 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=75, name=volume-07f984c4-a410-4d4b-be80-88b735fbd424, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Lock "cinder-quobyte-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9" released by "delete_volume" :: held 1.317s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424 2147483648" returned: 0 in 0.524s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Created reservations ['186e364b-eaac-42fb-b702-28bac4835484', '57cbe8ba-ba8d-42c6-92e6-12456c8a86e8', 'af7b4bb3-1989-4ecb-8655-3e9aade86df2', 'ae54e39b-a065-48a8-ae56-99ce5f512c21'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424" returned: 0 in 0.272s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] <== create_volume: return (816ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e844cc06-dfcb-43b7-ad5a-27ba6bc3358f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f984c4-a410-4d4b-be80-88b735fbd424', 'volume_size': 2}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676bd3ce-9554-4326-98b3-65a5a6dd0238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:34 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Volume volume-07f984c4-a410-4d4b-be80-88b735fbd424 (07f984c4-a410-4d4b-be80-88b735fbd424): created successfully
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676bd3ce-9554-4326-98b3-65a5a6dd0238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Flow 'volume_create_manager' (cd308566-5ac7-49c2-96c5-f4818e4e34da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8129065b-324d-4eed-974f-0f15d2e2a44a tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Created volume successfully.
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.129s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:31:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Deleted volume successfully.
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2532d098-0f64-4018-90b6-a91825f23b10 tempest-VolumesTestJSON-452792318 None] Lock "cinder-d1ce7a75-5638-4d61-8f3c-0bd130fc37e9-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:34 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Creating offline snapshot 8c8847f3-a3b3-4cbe-979b-c672a63c1403 of volume 07f984c4-a410-4d4b-be80-88b735fbd424 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e55c45f-8e7b-4b3f-ac05-d021f91945a6]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Acquiring lock "cinder-9ac26ee9-1847-45e3-bbc2-5b51a025b11b-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Lock "cinder-9ac26ee9-1847-45e3-bbc2-5b51a025b11b-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:35 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Acquiring lock "cinder-quobyte-9ac26ee9-1847-45e3-bbc2-5b51a025b11b" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Lock "cinder-quobyte-9ac26ee9-1847-45e3-bbc2-5b51a025b11b" acquired by "delete_volume" :: waited 0.012s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424" returned: 0 in 0.609s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403 2G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:35 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b28a0e-165b-4307-b2c2-538357cece4c]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:35 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=76, name=volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403 2G" returned: 0 in 0.290s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): qemu-img rebase -u -b volume-07f984c4-a410-4d4b-be80-88b735fbd424 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "qemu-img rebase -u -b volume-07f984c4-a410-4d4b-be80-88b735fbd424 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403" returned: 0 in 0.165s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403" returned: 0 in 0.101s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:36 devstack quobyte-client[83411]: System call of process 96015 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b" returned: 0 in 0.644s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403" returned: 0 in 0.190s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9ac26ee9-1847-45e3-bbc2-5b51a025b11b" returned: 0 in 0.206s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.info" returned: 0 in 0.174s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Lock "cinder-quobyte-9ac26ee9-1847-45e3-bbc2-5b51a025b11b" released by "delete_volume" :: held 1.229s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.info" returned: 0 in 0.290s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-862f4372-69ab-4c00-96f7-f494ef80544d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Create snapshot completed successfully
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Created reservations ['8241b28e-0a45-4786-a1db-d3e11b9e7439', 'fc654a84-a69b-46c0-a5c9-95c54a844c07', '01b7dfb2-e5c3-4d19-8694-a57fe10d1810', 'a10fadbd-ecb1-4c59-9817-1b81bb5a5559'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.089s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:31:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Deleted volume successfully.
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Acquiring lock "cinder-54f1f1bf-4b96-4215-8a70-412d57685681-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-db04856e-fe2e-4b35-98d5-54b98b250c81 tempest-VolumesTestJSON-452792318 None] Lock "cinder-9ac26ee9-1847-45e3-bbc2-5b51a025b11b-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Lock "cinder-54f1f1bf-4b96-4215-8a70-412d57685681-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:37 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Acquiring lock "cinder-quobyte-54f1f1bf-4b96-4215-8a70-412d57685681" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Lock "cinder-quobyte-54f1f1bf-4b96-4215-8a70-412d57685681" acquired by "delete_volume" :: waited 0.010s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[30edc2f8-3740-43c2-93e0-459ba5366547]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-54f1f1bf-4b96-4215-8a70-412d57685681 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Acquiring lock "cinder-8c8847f3-a3b3-4cbe-979b-c672a63c1403-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "cinder-8c8847f3-a3b3-4cbe-979b-c672a63c1403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:38 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Acquiring lock "cinder-quobyte-07f984c4-a410-4d4b-be80-88b735fbd424" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-54f1f1bf-4b96-4215-8a70-412d57685681" returned: 0 in 0.514s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-54f1f1bf-4b96-4215-8a70-412d57685681 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "cinder-quobyte-07f984c4-a410-4d4b-be80-88b735fbd424" acquired by "delete_snapshot" :: waited 0.190s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Acquiring lock "cinder-quobyte-8c8847f3-a3b3-4cbe-979b-c672a63c1403" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-54f1f1bf-4b96-4215-8a70-412d57685681" returned: 0 in 0.220s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Lock "cinder-quobyte-54f1f1bf-4b96-4215-8a70-412d57685681" released by "delete_volume" :: held 0.801s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=78,cinder:UPDATE=95,cinder:INSERT=31,cinder:DELETE=8 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "cinder-quobyte-8c8847f3-a3b3-4cbe-979b-c672a63c1403" acquired by "_delete_snapshot" :: waited 0.176s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Deleting offline snapshot 8c8847f3-a3b3-4cbe-979b-c672a63c1403 of volume 07f984c4-a410-4d4b-be80-88b735fbd424 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] snapshot_file for this snap is: volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[848fbaff-5b78-4750-acd1-fce88eeb2aa0]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=95,cinder:UPDATE=126,cinder:DELETE=13,cinder:INSERT=17 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:31:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Created reservations ['b156a841-3679-400d-84e4-f03513ddc57c', 'b4e264c9-5c89-4927-888c-25ddb960f8f4', 'a816446c-7793-4de5-8010-030184b80dfd', 'e5e03f57-e968-4e13-9d87-d24d1aa962f4'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403" returned: 0 in 0.735s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07f984c4-a410-4d4b-be80-88b735fbd424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:31:39 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-c8e8b6ca-79f0-47ea-ae8b-0c9419cce703 req-d62697cb-142a-4c34-b458-ef296c8fbd2f tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a604b063-d0cc-479f-b637-4c084aa9cd37]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.692s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:40 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:31:40 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-c8e8b6ca-79f0-47ea-ae8b-0c9419cce703 req-d62697cb-142a-4c34-b458-ef296c8fbd2f tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:40 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-c8e8b6ca-79f0-47ea-ae8b-0c9419cce703 req-d62697cb-142a-4c34-b458-ef296c8fbd2f tempest-TestInstancesWithCinderVolumes-1461621892 None] Terminate volume connection completed successfully.
Sep 16 11:31:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-c8e8b6ca-79f0-47ea-ae8b-0c9419cce703 req-d62697cb-142a-4c34-b458-ef296c8fbd2f tempest-TestInstancesWithCinderVolumes-1461621892 None] Deleting attachment 83f03c41-1b59-499b-92c2-efcf409eeb46. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:31:40 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Deleted volume successfully.
Sep 16 11:31:40 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fbb2568c-c64f-4331-b473-a753fac9db48 tempest-VolumesTestJSON-452792318 None] Lock "cinder-54f1f1bf-4b96-4215-8a70-412d57685681-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424" returned: 0 in 0.660s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:40 devstack quobyte-client[83411]: System call of process 96040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403" returned: 0 in 0.312s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424.8c8847f3-a3b3-4cbe-979b-c672a63c1403" returned: 0 in 0.130s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "cinder-quobyte-8c8847f3-a3b3-4cbe-979b-c672a63c1403" released by "_delete_snapshot" :: held 2.367s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "cinder-quobyte-07f984c4-a410-4d4b-be80-88b735fbd424" released by "delete_snapshot" :: held 2.584s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:41 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Created reservations ['3e06a741-62e2-46a2-af4e-8867ecabc877', 'ac3be47d-798f-4da4-8ae5-d641419d15a6', 'ba132b35-192b-4148-8c8b-d3130c0bd836', 'b312baa8-cd6b-4ae0-959e-28887f6b8618'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:41 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Delete snapshot completed successfully.
Sep 16 11:31:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-511fa600-ab6a-4310-9af8-194144ccbe1d tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "cinder-8c8847f3-a3b3-4cbe-979b-c672a63c1403-delete_snapshot" released by "delete_snapshot" :: held 3.402s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "cinder-3313228e-2dbb-4e5a-bbfb-43fc62958ea5-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Acquiring lock "cinder-07f984c4-a410-4d4b-be80-88b735fbd424-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-3313228e-2dbb-4e5a-bbfb-43fc62958ea5-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "cinder-07f984c4-a410-4d4b-be80-88b735fbd424-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "cinder-quobyte-3313228e-2dbb-4e5a-bbfb-43fc62958ea5" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Acquiring lock "cinder-quobyte-07f984c4-a410-4d4b-be80-88b735fbd424" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-quobyte-3313228e-2dbb-4e5a-bbfb-43fc62958ea5" acquired by "delete_volume" :: waited 0.046s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:43 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[15217dc7-a05b-4266-adb0-e8b777579eb8]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:43 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "cinder-quobyte-07f984c4-a410-4d4b-be80-88b735fbd424" acquired by "delete_volume" :: waited 0.321s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:43 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[da27d601-d736-4440-8a36-4289d9665f8d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5" returned: 0 in 1.250s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:44 devstack quobyte-client[83411]: System call of process 96051 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3313228e-2dbb-4e5a-bbfb-43fc62958ea5" returned: 0 in 0.236s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-quobyte-3313228e-2dbb-4e5a-bbfb-43fc62958ea5" released by "delete_volume" :: held 1.859s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424" returned: 0 in 1.653s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-07f984c4-a410-4d4b-be80-88b735fbd424" returned: 0 in 0.449s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "cinder-quobyte-07f984c4-a410-4d4b-be80-88b735fbd424" released by "delete_volume" :: held 2.504s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:45 devstack cinder-volume[83386]: WARNING cinder.quota [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622410824-1626671870 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622410824-1626671870, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:31:45 devstack cinder-volume[83386]: WARNING cinder.quota [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622410824-1626671870 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622410824-1626671870, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Created reservations ['36cb3301-b7d2-429e-8255-a595fe99feb9', '7181fce6-5cf8-4472-a427-8cc806573cea', '4b34bf07-c849-4996-86e3-6b126e52f4ab', '5dbffe1d-bd0d-46be-b185-a1b2b8b80c10'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Created reservations ['34c00c6b-2007-431c-8037-bfeaea9f2c9c', '7f173bc2-d625-4201-8d4c-6613caf7ef5a', 'd8f3efe4-25a3-433d-882e-d294494ef84c', '64798806-8c55-423e-9980-1a2586e29bf3'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:31:46 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-657eebd6-f8e3-44f5-bfcf-782c7737298e tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-657eebd6-f8e3-44f5-bfcf-782c7737298e tempest-GroupSnapshotsTest-869189185 None] Group tempest-GroupSnapshotsTest-Group-739952771: creating
Sep 16 11:31:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-657eebd6-f8e3-44f5-bfcf-782c7737298e tempest-GroupSnapshotsTest-869189185 None] Group tempest-GroupSnapshotsTest-Group-739952771: created successfully
Sep 16 11:31:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-657eebd6-f8e3-44f5-bfcf-782c7737298e tempest-GroupSnapshotsTest-869189185 None] Create group completed successfully.
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.477s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:46 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:31:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Deleted volume successfully.
Sep 16 11:31:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.341s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:47 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:31:47 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Deleted volume successfully.
Sep 16 11:31:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-99110f38-94d2-4e84-85e2-35030172a735 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-3313228e-2dbb-4e5a-bbfb-43fc62958ea5-delete_volume" released by "delete_volume" :: held 4.377s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9ad3a115-3d11-4ef1-ad66-de5d722cccfa tempest-VolumesSnapshotNegativeTestJSON-18063418 None] Lock "cinder-07f984c4-a410-4d4b-be80-88b735fbd424-delete_volume" released by "delete_volume" :: held 4.379s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:31:47 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:47 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Flow 'volume_create_manager' (dcbce8c8-36d8-4dc8-87e0-e0fd30e8b581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740a7b83-be1a-4325-8cf8-fb6ba61e390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740a7b83-be1a-4325-8cf8-fb6ba61e390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-743894094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a9bf90fc-4785-4c10-978a-1edef6e73d3d,host='devstack@QuobyteHD#QuobyteHD',id=0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de785a0fe68441ab0539bcf863d76fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:48Z,use_quota=True,user_id='33b726feeb8f4076963aa15d45ac8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4af76e29-bf8b-473a-a65a-f74e4a383932),volume_type_id=4af76e29-bf8b-473a-a65a-f74e4a383932)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5504d7d8-427c-4b96-bd2f-3437f3c96f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5504d7d8-427c-4b96-bd2f-3437f3c96f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf0c603-0907-466d-bda1-156e44e71620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf0c603-0907-466d-bda1-156e44e71620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8', 'volume_name': 'volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f247124-b040-4ad7-8914-7b63b4f3160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f247124-b040-4ad7-8914-7b63b4f3160a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91e6ff0-1872-4503-8c77-69d146a45630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:48 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Volume 0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8', 'volume_size': 1}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a9bf90fc-4785-4c10-978a-1edef6e73d3d,created_at=2025-09-16T09:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-743894094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a9bf90fc-4785-4c10-978a-1edef6e73d3d,host='devstack@QuobyteHD#QuobyteHD',id=0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de785a0fe68441ab0539bcf863d76fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:31:48Z,use_quota=True,user_id='33b726feeb8f4076963aa15d45ac8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4af76e29-bf8b-473a-a65a-f74e4a383932),volume_type_id=4af76e29-bf8b-473a-a65a-f74e4a383932)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Creating volume 0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:31:48 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:48 devstack quobyte-client[83411]: System call of process 96082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:48 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=78, name=volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 1073741824" returned: 0 in 0.540s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" returned: 0 in 0.175s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] <== create_volume: return (798ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:31:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91e6ff0-1872-4503-8c77-69d146a45630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d029ed85-95f2-45e4-b012-1d963b734430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:31:49 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Volume volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 (0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8): created successfully
Sep 16 11:31:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d029ed85-95f2-45e4-b012-1d963b734430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:31:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Flow 'volume_create_manager' (dcbce8c8-36d8-4dc8-87e0-e0fd30e8b581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:31:49 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-695b2d62-768b-4ecf-8d09-e83dd24ce48a tempest-GroupSnapshotsTest-869189185 None] Created volume successfully.
Sep 16 11:31:50 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] GroupSnapshot 2139d849-8e05-4128-9ef8-c95233bee384: creating.
Sep 16 11:31:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Group snapshot 2139d849-8e05-4128-9ef8-c95233bee384: creating. {{(pid=83386) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 16 11:31:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Creating offline snapshot 85f239fa-2188-443e-a709-f5ba4349ca77 of volume 0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:31:51 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b9880e-ce67-4b5a-a822-7e96efb940c8]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" returned: 0 in 0.691s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:52 devstack quobyte-client[83411]: System call of process 96128 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:31:52 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=79, name=volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:31:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 1G" returned: 0 in 0.595s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img rebase -u -b volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77" returned: 0 in 0.321s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77" returned: 0 in 0.174s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77" returned: 0 in 0.222s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.info" returned: 0 in 0.133s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.info" returned: 0 in 0.127s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:54 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3727120b-176f-45d5-8f5b-77ce845b4713 tempest-GroupSnapshotsTest-869189185 None] group_snapshot 2139d849-8e05-4128-9ef8-c95233bee384: created successfully
Sep 16 11:31:56 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-85f239fa-2188-443e-a709-f5ba4349ca77-7438d282-7f11-40f2-8395-1bb397c50560" by "_create_volume_from_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-85f239fa-2188-443e-a709-f5ba4349ca77-7438d282-7f11-40f2-8395-1bb397c50560" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Creating volume 7438d282-7f11-40f2-8395-1bb397c50560 from snapshot 85f239fa-2188-443e-a709-f5ba4349ca77 {{(pid=83386) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:31:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-7438d282-7f11-40f2-8395-1bb397c50560" by "_copy_volume_from_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-7438d282-7f11-40f2-8395-1bb397c50560" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] snapshot: 85f239fa-2188-443e-a709-f5ba4349ca77, volume: 7438d282-7f11-40f2-8395-1bb397c50560,  {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6194659-991d-4448-956b-fb0a8c67329b]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77" returned: 0 in 0.421s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Creating direct copy from snapshot {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[05563e3e-9f1e-44e0-a5bf-d4b26e0df11f]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:31:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" returned: 0 in 0.603s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:31:58 devstack cinder-volume[83386]: DEBUG cinder.utils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560 not found in is_blk_device check {{(pid=83386) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 16 11:31:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:31:58 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=81, name=volume-7438d282-7f11-40f2-8395-1bb397c50560, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:32:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560" returned: 0 in 6.626s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:04 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa91eab-78a0-409a-8b61-12589f12690d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:05 devstack quobyte-client[83411]: System call of process 96169 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:32:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" returned: 0 in 0.920s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:05 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Image conversion details: src /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560 {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:32:05 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Converted 1024.00 MB image at 153.59 MB/s
Sep 16 11:32:05 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:32:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560" returned: 0 in 0.114s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-7438d282-7f11-40f2-8395-1bb397c50560" released by "_copy_volume_from_snapshot" :: held 9.111s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-85f239fa-2188-443e-a709-f5ba4349ca77-7438d282-7f11-40f2-8395-1bb397c50560" released by "_create_volume_from_snapshot" :: held 9.147s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.205s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-29784d11-60e5-4db7-8706-314996799ee1 tempest-GroupSnapshotsTest-869189185 None] Create group from source-snapshot-2139d849-8e05-4128-9ef8-c95233bee384 completed successfully.
Sep 16 11:32:08 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-7438d282-7f11-40f2-8395-1bb397c50560" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-7438d282-7f11-40f2-8395-1bb397c50560" acquired by "delete_volume" :: waited 0.021s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:08 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e639b1-7b8a-4251-8fcb-625090f1e62d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560" returned: 0 in 0.482s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7438d282-7f11-40f2-8395-1bb397c50560" returned: 0 in 0.120s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-7438d282-7f11-40f2-8395-1bb397c50560" released by "delete_volume" :: held 0.800s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:10 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Created reservations ['5e7f60b8-6a22-4a0f-9e10-9403a4ce0a62'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:32:10 devstack cinder-volume[83386]: WARNING cinder.quota [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-770314494 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-770314494, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:32:10 devstack cinder-volume[83386]: WARNING cinder.quota [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-770314494 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-770314494, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:32:10 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Created reservations ['40a19096-3165-4ba4-9e33-cee15539de10', '62b4feb2-ebcc-4d87-a36d-814aff6dd805', 'b3ebe438-0456-42bb-ba29-a59217b66173', 'c5fd4e55-1e7e-477a-be91-9c9de8382df5'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:32:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:32:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:32:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.164s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:10 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:32:11 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-be22a868-2896-4cf6-bd85-3d3e16e7bce2 tempest-GroupSnapshotsTest-869189185 None] Delete group completed successfully.
Sep 16 11:32:11 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] group_snapshot 2139d849-8e05-4128-9ef8-c95233bee384: deleting
Sep 16 11:32:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] group_snapshot 2139d849-8e05-4128-9ef8-c95233bee384: deleting {{(pid=83386) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 16 11:32:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" acquired by "delete_snapshot" :: waited 0.046s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-85f239fa-2188-443e-a709-f5ba4349ca77" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-85f239fa-2188-443e-a709-f5ba4349ca77" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Deleting offline snapshot 85f239fa-2188-443e-a709-f5ba4349ca77 of volume 0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:32:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] snapshot_file for this snap is: volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:32:11 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fcac4a-0409-44a7-ba80-fc305ac488e0]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77" returned: 0 in 0.453s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:32:12 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95a2fcd-5a3b-4758-8d73-91a40db57749]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" returned: 0 in 0.483s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77" returned: 0 in 0.249s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8.85f239fa-2188-443e-a709-f5ba4349ca77" returned: 0 in 0.107s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-85f239fa-2188-443e-a709-f5ba4349ca77" released by "_delete_snapshot" :: held 1.659s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" released by "delete_snapshot" :: held 1.692s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:13 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-ff494458-9a37-40b9-bced-cc077328e11d req-75ab6b99-d0a2-4922-9c26-69df84aaba09 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-ff494458-9a37-40b9-bced-cc077328e11d req-75ab6b99-d0a2-4922-9c26-69df84aaba09 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-ff494458-9a37-40b9-bced-cc077328e11d req-75ab6b99-d0a2-4922-9c26-69df84aaba09 tempest-TestInstancesWithCinderVolumes-1461621892 None] Terminate volume connection completed successfully.
Sep 16 11:32:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-ff494458-9a37-40b9-bced-cc077328e11d req-75ab6b99-d0a2-4922-9c26-69df84aaba09 tempest-TestInstancesWithCinderVolumes-1461621892 None] Deleting attachment e78b4852-c949-4288-bdbc-5c8961a356af. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:32:14 devstack cinder-volume[83386]: WARNING cinder.quota [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-770314494 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-770314494, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:32:14 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] Created reservations ['e894d3b3-6ca6-4601-b444-83ca961f8bb1', '1b707d59-2104-4fc4-926a-f60e0f68d8ec', '8c346a85-1a3b-4fa2-9ef5-54db11a5a06d', '33a36535-302c-4af8-a77c-e7279c4f195a'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:32:15 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-34708fcd-4b88-4341-9920-260b45b6b4ba tempest-GroupSnapshotsTest-869189185 None] group_snapshot 2139d849-8e05-4128-9ef8-c95233bee384: deleted successfully
Sep 16 11:32:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "cinder-b9801619-0e4b-453b-aa2b-9591ddba3da2-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-b9801619-0e4b-453b-aa2b-9591ddba3da2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:17 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "cinder-quobyte-b9801619-0e4b-453b-aa2b-9591ddba3da2" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-quobyte-b9801619-0e4b-453b-aa2b-9591ddba3da2" acquired by "delete_volume" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:17 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[592916aa-d207-470f-9aa3-42bc3822d8ae]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b9801619-0e4b-453b-aa2b-9591ddba3da2 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b9801619-0e4b-453b-aa2b-9591ddba3da2" returned: 0 in 0.864s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b9801619-0e4b-453b-aa2b-9591ddba3da2 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" acquired by "delete_volume" :: waited 0.268s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:19 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dba8b9-dd24-4d6a-9f7c-53437fd79704]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b9801619-0e4b-453b-aa2b-9591ddba3da2" returned: 0 in 0.410s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:19 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-quobyte-b9801619-0e4b-453b-aa2b-9591ddba3da2" released by "delete_volume" :: held 1.588s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:19 devstack cinder-volume[83386]: WARNING cinder.quota [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-622111740-646827210 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-622111740-646827210, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:32:19 devstack cinder-volume[83386]: WARNING cinder.quota [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-622111740-646827210 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-622111740-646827210, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:32:19 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Created reservations ['a18776cc-138a-4e52-9561-b9e58841deb3', '424d74ec-2bf2-4951-a2ba-f6fba70f3a28', '3968d308-bf97-412c-8fbc-8db5f385d660', '1a57d2f5-d1f3-4e9e-9ce6-9e3dc038a671'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:32:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" returned: 0 in 0.983s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" returned: 0 in 0.247s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-0b117fd5-dd1f-40e2-a456-e2ea40a1d8a8" released by "delete_volume" :: held 1.512s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:32:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:32:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.354s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:21 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:32:21 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Deleted volume successfully.
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cd4d9124-1294-46f9-9250-d1b4fea9e7eb tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-b9801619-0e4b-453b-aa2b-9591ddba3da2-delete_volume" released by "delete_volume" :: held 7.665s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Created reservations ['3eec7218-2bb5-4bc2-b309-0b660ab07e14'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:32:25 devstack cinder-volume[83386]: WARNING cinder.db.sqlalchemy.api [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-770314494']
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Created reservations ['9f5746ef-6b98-441a-8ed7-658bc31d86d6', 'fc584f25-1958-467a-9893-11e32e4fe2b5', '11ea34e9-90c7-44a9-abb1-cd48d2abb9a2', 'a1f4eddf-0914-48a7-ae8d-3907d9878636'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.133s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:32:25 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2cbcd559-d991-447d-adbb-d05abce9368e tempest-GroupSnapshotsTest-869189185 None] Delete group completed successfully.
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:32:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.345s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:32:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-0019286a-dc88-45c8-82bf-740d2c56c8b7 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-0019286a-dc88-45c8-82bf-740d2c56c8b7 tempest-GroupSnapshotsTest-869189185 None] Group tempest-GroupSnapshotsTest-Group-659752293: creating
Sep 16 11:32:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-0019286a-dc88-45c8-82bf-740d2c56c8b7 tempest-GroupSnapshotsTest-869189185 None] Group tempest-GroupSnapshotsTest-Group-659752293: created successfully
Sep 16 11:32:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-0019286a-dc88-45c8-82bf-740d2c56c8b7 tempest-GroupSnapshotsTest-869189185 None] Create group completed successfully.
Sep 16 11:32:29 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:29 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Flow 'volume_create_manager' (ba5563a0-a056-40f0-ab0c-b11c10487dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2befdc-1555-488b-8052-5d5821f1d421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2befdc-1555-488b-8052-5d5821f1d421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-949187732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07da90c8-81b7-4fde-b73e-7406e2ea2127,host='devstack@QuobyteHD#QuobyteHD',id=d226a8fb-4763-420b-aa6c-9dfe88421b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de785a0fe68441ab0539bcf863d76fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:32:30Z,use_quota=True,user_id='33b726feeb8f4076963aa15d45ac8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7983b347-7b1b-4d03-883d-f5ee371d869c),volume_type_id=7983b347-7b1b-4d03-883d-f5ee371d869c)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c13bab1-5e1c-4c15-b9c2-48fb7c537c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c13bab1-5e1c-4c15-b9c2-48fb7c537c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852d55ff-5e3c-4c1c-88cd-1e3c397a6ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (852d55ff-5e3c-4c1c-88cd-1e3c397a6ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd226a8fb-4763-420b-aa6c-9dfe88421b70', 'volume_name': 'volume-d226a8fb-4763-420b-aa6c-9dfe88421b70', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2679177-3f55-47f5-8da6-ec35c98ac2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2679177-3f55-47f5-8da6-ec35c98ac2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f7f009-1a45-4457-a82f-b3468e3b51b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:30 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Volume d226a8fb-4763-420b-aa6c-9dfe88421b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d226a8fb-4763-420b-aa6c-9dfe88421b70', 'volume_size': 1}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07da90c8-81b7-4fde-b73e-7406e2ea2127,created_at=2025-09-16T09:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-949187732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07da90c8-81b7-4fde-b73e-7406e2ea2127,host='devstack@QuobyteHD#QuobyteHD',id=d226a8fb-4763-420b-aa6c-9dfe88421b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de785a0fe68441ab0539bcf863d76fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:32:30Z,use_quota=True,user_id='33b726feeb8f4076963aa15d45ac8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7983b347-7b1b-4d03-883d-f5ee371d869c),volume_type_id=7983b347-7b1b-4d03-883d-f5ee371d869c)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Creating volume d226a8fb-4763-420b-aa6c-9dfe88421b70 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.179s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:32:30 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:32:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:31 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=82, name=volume-d226a8fb-4763-420b-aa6c-9dfe88421b70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:32:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 1073741824" returned: 0 in 0.628s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70" returned: 0 in 0.282s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] <== create_volume: return (1255ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:32:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f7f009-1a45-4457-a82f-b3468e3b51b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d226a8fb-4763-420b-aa6c-9dfe88421b70', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b906ac7-b56a-4023-ab2d-61c7b77ea488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:32 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Volume volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 (d226a8fb-4763-420b-aa6c-9dfe88421b70): created successfully
Sep 16 11:32:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b906ac7-b56a-4023-ab2d-61c7b77ea488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Flow 'volume_create_manager' (ba5563a0-a056-40f0-ab0c-b11c10487dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:32:32 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ecb83f2c-1b07-431b-93e7-87564945b6f2 tempest-GroupSnapshotsTest-869189185 None] Created volume successfully.
Sep 16 11:32:34 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Flow 'volume_create_manager' (ec722a8d-43fe-4c39-b696-205447a6c08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982aa3f1-15d3-484b-95dc-b1958b7b604b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982aa3f1-15d3-484b-95dc-b1958b7b604b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1289178252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07da90c8-81b7-4fde-b73e-7406e2ea2127,host='devstack@QuobyteHD#QuobyteHD',id=0d993e04-8fd7-4fb3-ba26-0b1b238d2e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de785a0fe68441ab0539bcf863d76fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:32:34Z,use_quota=True,user_id='33b726feeb8f4076963aa15d45ac8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7983b347-7b1b-4d03-883d-f5ee371d869c),volume_type_id=7983b347-7b1b-4d03-883d-f5ee371d869c)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ab6c43-3e39-4984-ac0a-16f476b1dc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ab6c43-3e39-4984-ac0a-16f476b1dc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99479f5-1da0-460e-8cac-048d784b4b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99479f5-1da0-460e-8cac-048d784b4b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d993e04-8fd7-4fb3-ba26-0b1b238d2e58', 'volume_name': 'volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e382d9-b023-49e9-8411-cb209f14ce3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e382d9-b023-49e9-8411-cb209f14ce3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004de567-bd8d-4af5-b9aa-07851adfd44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:34 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Volume 0d993e04-8fd7-4fb3-ba26-0b1b238d2e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58', 'volume_size': 1}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07da90c8-81b7-4fde-b73e-7406e2ea2127,created_at=2025-09-16T09:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1289178252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07da90c8-81b7-4fde-b73e-7406e2ea2127,host='devstack@QuobyteHD#QuobyteHD',id=0d993e04-8fd7-4fb3-ba26-0b1b238d2e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de785a0fe68441ab0539bcf863d76fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:32:34Z,use_quota=True,user_id='33b726feeb8f4076963aa15d45ac8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7983b347-7b1b-4d03-883d-f5ee371d869c),volume_type_id=7983b347-7b1b-4d03-883d-f5ee371d869c)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Creating volume 0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:32:34 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:32:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:34 devstack quobyte-client[83411]: System call of process 96255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:32:34 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=83, name=volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:32:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 1073741824" returned: 0 in 0.523s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" returned: 0 in 0.165s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] <== create_volume: return (809ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:32:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:35 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-3120715e-31c4-4450-afba-2402c399e8fa req-28cf482c-d815-4dd7-bf71-6560a8c93b06 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004de567-bd8d-4af5-b9aa-07851adfd44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac0d77a-121c-4c01-afd5-ab483b7d0caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:32:36 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-3120715e-31c4-4450-afba-2402c399e8fa req-28cf482c-d815-4dd7-bf71-6560a8c93b06 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:36 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-3120715e-31c4-4450-afba-2402c399e8fa req-28cf482c-d815-4dd7-bf71-6560a8c93b06 tempest-TestInstancesWithCinderVolumes-1461621892 None] Terminate volume connection completed successfully.
Sep 16 11:32:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-3120715e-31c4-4450-afba-2402c399e8fa req-28cf482c-d815-4dd7-bf71-6560a8c93b06 tempest-TestInstancesWithCinderVolumes-1461621892 None] Deleting attachment 0fd67f64-8bf6-411f-a3cf-461a87714270. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:32:36 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Volume volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 (0d993e04-8fd7-4fb3-ba26-0b1b238d2e58): created successfully
Sep 16 11:32:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac0d77a-121c-4c01-afd5-ab483b7d0caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:32:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Flow 'volume_create_manager' (ec722a8d-43fe-4c39-b696-205447a6c08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:32:36 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-9e3ff0ec-353b-4033-9faa-2c9ddfed8623 tempest-GroupSnapshotsTest-869189185 None] Created volume successfully.
Sep 16 11:32:36 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-72594e32-c24c-41ba-80b0-73b36ee042df tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:36 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-72594e32-c24c-41ba-80b0-73b36ee042df tempest-GroupSnapshotsTest-869189185 None] Update group completed successfully.
Sep 16 11:32:38 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5ba42a1c-8f7c-45fd-bd81-ee7eb31704b4 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:38 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5ba42a1c-8f7c-45fd-bd81-ee7eb31704b4 tempest-GroupSnapshotsTest-869189185 None] Update group completed successfully.
Sep 16 11:32:39 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=76,cinder:INSERT=17,cinder:UPDATE=93,cinder:DELETE=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:32:39 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-22c9f19a-d98a-49ba-a876-dc3f07d7dcb3 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:39 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=69,cinder:UPDATE=62,cinder:DELETE=4,cinder:INSERT=17 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:32:39 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-22c9f19a-d98a-49ba-a876-dc3f07d7dcb3 tempest-GroupSnapshotsTest-869189185 None] Update group completed successfully.
Sep 16 11:32:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "cinder-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:39 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "cinder-quobyte-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-quobyte-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" acquired by "delete_volume" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:40 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b0e8de-658f-44c2-b5ae-3b7de2e035df]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" returned: 0 in 0.638s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:41 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-decebf6b-b03b-42a5-8884-1adb5fc2a444 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" returned: 1 in 0.769s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:32:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:42 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-decebf6b-b03b-42a5-8884-1adb5fc2a444 tempest-GroupSnapshotsTest-869189185 None] Update group completed successfully.
Sep 16 11:32:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" returned: 0 in 0.559s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-quobyte-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde" released by "delete_volume" :: held 2.161s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:42 devstack cinder-volume[83386]: WARNING cinder.quota [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1270255192-1922235355 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1270255192-1922235355, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:32:42 devstack cinder-volume[83386]: WARNING cinder.quota [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1270255192-1922235355 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1270255192-1922235355, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:32:42 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] GroupSnapshot 896b7189-93c9-4037-914b-020fa45e4dac: creating.
Sep 16 11:32:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Group snapshot 896b7189-93c9-4037-914b-020fa45e4dac: creating. {{(pid=83386) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 16 11:32:42 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Created reservations ['4ecdd171-4ced-44c6-83bc-4166adfcf842', 'f1b20d9f-dfa4-4726-8e01-47705d672c1e', 'c22a28ae-24e7-4368-b87a-3e2492235d57', '7f86b1e7-80a2-42bb-a658-b18b7b82ccfb'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:32:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Creating offline snapshot 32908792-9d75-43e4-9eae-6dd8ff46c880 of volume 0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:32:42 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e52e451-a0d5-46bb-9671-79d25478b576]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" returned: 0 in 0.685s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.322s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:32:43 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=84, name=volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:32:43 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Deleted volume successfully.
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880 1G" returned: 0 in 0.429s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:44 devstack quobyte-client[83411]: System call of process 96277 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-09e6a3b4-7bd4-4c90-9c8e-c8d87d9223d7 tempest-TestInstancesWithCinderVolumes-1461621892 None] Lock "cinder-cf64b3d6-4ea7-4b0d-a855-db51c17c1dde-delete_volume" released by "delete_volume" :: held 4.187s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img rebase -u -b volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880" returned: 0 in 0.300s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880" returned: 0 in 0.105s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880" returned: 0 in 0.111s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.info" returned: 0 in 0.178s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.info" returned: 0 in 0.101s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.397s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:32:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:32:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Creating offline snapshot fb20c5b7-880b-4244-aa9a-7e3e0694085f of volume d226a8fb-4763-420b-aa6c-9dfe88421b70 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:32:45 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e111ce8c-ac6a-4c28-8dda-4686031a57ea]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70" returned: 0 in 0.746s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:46 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=86, name=volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:32:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f 1G" returned: 0 in 0.339s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img rebase -u -b volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f" returned: 0 in 0.405s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f" returned: 0 in 0.119s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f" returned: 0 in 0.122s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.info" returned: 0 in 0.161s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.info" returned: 0 in 0.112s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.931s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:32:48 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-54a16f33-3e30-461c-92b6-93fdf8168267 tempest-GroupSnapshotsTest-869189185 None] group_snapshot 896b7189-93c9-4037-914b-020fa45e4dac: created successfully
Sep 16 11:32:49 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] group_snapshot 896b7189-93c9-4037-914b-020fa45e4dac: deleting
Sep 16 11:32:49 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:32:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] group_snapshot 896b7189-93c9-4037-914b-020fa45e4dac: deleting {{(pid=83386) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 16 11:32:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" acquired by "delete_snapshot" :: waited 0.083s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-32908792-9d75-43e4-9eae-6dd8ff46c880" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-32908792-9d75-43e4-9eae-6dd8ff46c880" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Deleting offline snapshot 32908792-9d75-43e4-9eae-6dd8ff46c880 of volume 0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:32:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] snapshot_file for this snap is: volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:32:49 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[89381712-78a5-4285-8481-f6d69eaf0409]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880" returned: 0 in 0.635s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:32:50 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8399a6e-4140-446f-b9b2-53a9d4344f54]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" returned: 0 in 0.570s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880" returned: 0 in 0.600s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58.32908792-9d75-43e4-9eae-6dd8ff46c880" returned: 0 in 0.308s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-32908792-9d75-43e4-9eae-6dd8ff46c880" released by "_delete_snapshot" :: held 2.881s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" released by "delete_snapshot" :: held 2.984s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-d226a8fb-4763-420b-aa6c-9dfe88421b70" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-d226a8fb-4763-420b-aa6c-9dfe88421b70" acquired by "delete_snapshot" :: waited 0.126s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-fb20c5b7-880b-4244-aa9a-7e3e0694085f" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:32:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-fb20c5b7-880b-4244-aa9a-7e3e0694085f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:32:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Deleting offline snapshot fb20c5b7-880b-4244-aa9a-7e3e0694085f of volume d226a8fb-4763-420b-aa6c-9dfe88421b70 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:32:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] snapshot_file for this snap is: volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:32:53 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3b850e-bb6b-42f1-9d59-1a1ccd462490]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:54 devstack quobyte-client[83411]: System call of process 96342 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:32:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f" returned: 0 in 1.485s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d226a8fb-4763-420b-aa6c-9dfe88421b70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:32:55 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f93e25b-8ec4-4626-b8d1-e67d9c65a99a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:32:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70" returned: 0 in 1.077s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f" returned: 0 in 0.633s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:32:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70.fb20c5b7-880b-4244-aa9a-7e3e0694085f" returned: 0 in 0.174s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:32:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-fb20c5b7-880b-4244-aa9a-7e3e0694085f" released by "_delete_snapshot" :: held 4.477s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-d226a8fb-4763-420b-aa6c-9dfe88421b70" released by "delete_snapshot" :: held 4.543s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:32:58 devstack cinder-volume[83386]: WARNING cinder.quota [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2027373302 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2027373302, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:32:58 devstack cinder-volume[83386]: WARNING cinder.quota [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2027373302 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2027373302, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:32:59 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Created reservations ['74e85b21-0179-4e71-b7b7-8e88d15fbfe2', '3343bd81-6a4c-4da4-90cc-2503b921ed8a', '0bf99744-043a-4aa1-a4d7-2a7e1c364b48', '5bec44a4-bf69-49ac-bb7c-6299b9e5ac41'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:32:59 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] Created reservations ['bf12b4f8-57a8-4408-a5a6-968e7faebd9b', '2f71839b-460f-473c-9b6b-e9d82e4b0835', '0e25975c-1bee-478f-9cf2-06abf455edb9', 'b3b80da3-51a3-4e5e-ae6a-a2379e37ddec'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:32:59 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8facf956-0696-4421-a9ac-2e71d267ddfb tempest-GroupSnapshotsTest-869189185 None] group_snapshot 896b7189-93c9-4037-914b-020fa45e4dac: deleted successfully
Sep 16 11:33:01 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:01 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:01 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" acquired by "delete_volume" :: waited 0.030s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:01 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[61de76bd-1489-4b97-a5b1-d910961a144d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" returned: 0 in 0.668s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" returned: 0 in 0.174s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-0d993e04-8fd7-4fb3-ba26-0b1b238d2e58" released by "delete_volume" :: held 1.140s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-d226a8fb-4763-420b-aa6c-9dfe88421b70" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-d226a8fb-4763-420b-aa6c-9dfe88421b70" acquired by "delete_volume" :: waited 0.089s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:02 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[deebeb3c-fad2-402d-bb92-94ff0f2f534f]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70" returned: 0 in 0.993s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d226a8fb-4763-420b-aa6c-9dfe88421b70" returned: 0 in 0.160s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-d226a8fb-4763-420b-aa6c-9dfe88421b70" released by "delete_volume" :: held 1.392s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:04 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Created reservations ['a774692b-c25f-40ab-b1f2-74f8a50dd31a'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:33:04 devstack cinder-volume[83386]: WARNING cinder.quota [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2027373302 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2027373302, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:33:04 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Created reservations ['b262a0a4-41b1-459c-9a2f-40f0cf68bd10', '7d606c91-21a8-4ef1-bf33-931120ab1c16', '75377dbf-4fd4-4ca1-9b2c-3fa29ad9b2fb', '35e8ae0c-95de-47dc-8aaa-64a7b9f7c451'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:33:05 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Created reservations ['62bd4824-21a9-47fd-992f-14cfa1b50c0d', 'bacddd5c-cdcb-4022-b6f0-57125e876db4', '4cda59dd-5b13-4ae6-858c-e5f7422ef73a', '10098f33-99bb-48b5-9b39-aa552dcf9ad8'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:33:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:05 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:05 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.094s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:05 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:33:05 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-4ecb176c-60de-4fd8-8558-5f1dcafe572f tempest-GroupSnapshotsTest-869189185 None] Delete group completed successfully.
Sep 16 11:33:08 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-04c963ff-17a1-4c2a-9636-8c91a2d37a0d tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:08 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-04c963ff-17a1-4c2a-9636-8c91a2d37a0d tempest-GroupSnapshotsTest-869189185 None] Group tempest-GroupSnapshotsTest-Group-399158078: creating
Sep 16 11:33:08 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-04c963ff-17a1-4c2a-9636-8c91a2d37a0d tempest-GroupSnapshotsTest-869189185 None] Group tempest-GroupSnapshotsTest-Group-399158078: created successfully
Sep 16 11:33:08 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-04c963ff-17a1-4c2a-9636-8c91a2d37a0d tempest-GroupSnapshotsTest-869189185 None] Create group completed successfully.
Sep 16 11:33:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Flow 'volume_create_manager' (b9b23a6c-4687-4685-93de-5eaff82a82f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a09a788-9437-47e4-afae-7055c40f2cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a09a788-9437-47e4-afae-7055c40f2cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132234140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8ca05cec-e85c-4eca-aa52-2452e0c11bf9,host='devstack@QuobyteHD#QuobyteHD',id=ab8a0e4d-db5d-44c0-bb53-c414d68304ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de785a0fe68441ab0539bcf863d76fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:11Z,use_quota=True,user_id='33b726feeb8f4076963aa15d45ac8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(addb37b0-0a0d-42e1-a7c9-0293d4ae8434),volume_type_id=addb37b0-0a0d-42e1-a7c9-0293d4ae8434)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99562a2-71ca-470e-b78b-77ba52ca9d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99562a2-71ca-470e-b78b-77ba52ca9d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e63f799-46ad-40de-8903-285fb37afa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e63f799-46ad-40de-8903-285fb37afa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab8a0e4d-db5d-44c0-bb53-c414d68304ea', 'volume_name': 'volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1309badf-3b2f-47e8-b985-7ed2335f03f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1309badf-3b2f-47e8-b985-7ed2335f03f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6530126e-b3fc-4b88-b597-5e7520aa4e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:11 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Volume ab8a0e4d-db5d-44c0-bb53-c414d68304ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea', 'volume_size': 1}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8ca05cec-e85c-4eca-aa52-2452e0c11bf9,created_at=2025-09-16T09:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132234140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8ca05cec-e85c-4eca-aa52-2452e0c11bf9,host='devstack@QuobyteHD#QuobyteHD',id=ab8a0e4d-db5d-44c0-bb53-c414d68304ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0de785a0fe68441ab0539bcf863d76fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:11Z,use_quota=True,user_id='33b726feeb8f4076963aa15d45ac8a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(addb37b0-0a0d-42e1-a7c9-0293d4ae8434),volume_type_id=addb37b0-0a0d-42e1-a7c9-0293d4ae8434)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Creating volume ab8a0e4d-db5d-44c0-bb53-c414d68304ea {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:33:11 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:33:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:11 devstack quobyte-client[83411]: System call of process 96473 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:11 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=88, name=volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:33:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea 1073741824" returned: 0 in 0.730s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" returned: 0 in 0.303s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] <== create_volume: return (1210ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:33:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6530126e-b3fc-4b88-b597-5e7520aa4e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf1a2cf-2641-4858-bc66-deb19e9913e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:12 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Volume volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea (ab8a0e4d-db5d-44c0-bb53-c414d68304ea): created successfully
Sep 16 11:33:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf1a2cf-2641-4858-bc66-deb19e9913e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Flow 'volume_create_manager' (b9b23a6c-4687-4685-93de-5eaff82a82f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:13 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-4c2836ff-180b-4bf6-b0f9-55b2f5f37f27 tempest-GroupSnapshotsTest-869189185 None] Created volume successfully.
Sep 16 11:33:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] GroupSnapshot 90a7907a-3983-4b85-bcef-90fd873a0657: creating.
Sep 16 11:33:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Group snapshot 90a7907a-3983-4b85-bcef-90fd873a0657: creating. {{(pid=83386) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 16 11:33:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Creating offline snapshot aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 of volume ab8a0e4d-db5d-44c0-bb53-c414d68304ea {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:33:14 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d5c0a7-5cd6-4379-aea9-7ff7b1f3b160]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" returned: 0 in 0.702s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:15 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=89, name=volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:33:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 1G" returned: 0 in 0.411s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img rebase -u -b volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548" returned: 0 in 0.272s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548" returned: 0 in 0.115s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548" returned: 0 in 0.182s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.info" returned: 0 in 0.194s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:33:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.info" returned: 0 in 0.213s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:17 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (760ec690-3d75-4868-a5a2-9bb7a95cc290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c1a959-5cc5-4e1f-bf8e-e018ee3271ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c1a959-5cc5-4e1f-bf8e-e018ee3271ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1417300527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480aef72-f2cf-4a24-9807-a12c07b596f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:17Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b755956b-9c7b-4094-b9a6-37a8fa35ef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b755956b-9c7b-4094-b9a6-37a8fa35ef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc028f93-354b-4548-8c55-c7350a7d278e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc028f93-354b-4548-8c55-c7350a7d278e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480aef72-f2cf-4a24-9807-a12c07b596f7', 'volume_name': 'volume-480aef72-f2cf-4a24-9807-a12c07b596f7', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e363258-98cc-450c-828a-92afed5183a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e363258-98cc-450c-828a-92afed5183a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a31f99-2d90-43c5-a900-325368210c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:17 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume 480aef72-f2cf-4a24-9807-a12c07b596f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480aef72-f2cf-4a24-9807-a12c07b596f7', 'volume_size': 1}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1417300527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480aef72-f2cf-4a24-9807-a12c07b596f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:17Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Creating volume 480aef72-f2cf-4a24-9807-a12c07b596f7 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:33:17 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:33:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:18 devstack quobyte-client[83411]: System call of process 96504 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:18 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=91, name=volume-480aef72-f2cf-4a24-9807-a12c07b596f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:33:18 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-df8a64c2-6d3a-4cd4-b07d-920d23d81fd2 tempest-GroupSnapshotsTest-869189185 None] group_snapshot 90a7907a-3983-4b85-bcef-90fd873a0657: created successfully
Sep 16 11:33:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7 1073741824" returned: 0 in 0.587s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7" returned: 0 in 0.257s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] <== create_volume: return (914ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:33:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:19 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] group_snapshot 90a7907a-3983-4b85-bcef-90fd873a0657: deleting
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a31f99-2d90-43c5-a900-325368210c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480aef72-f2cf-4a24-9807-a12c07b596f7', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fc7f6b-2642-4506-9454-82945bf13604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:19 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] group_snapshot 90a7907a-3983-4b85-bcef-90fd873a0657: deleting {{(pid=83386) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 16 11:33:19 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume volume-480aef72-f2cf-4a24-9807-a12c07b596f7 (480aef72-f2cf-4a24-9807-a12c07b596f7): created successfully
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fc7f6b-2642-4506-9454-82945bf13604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (760ec690-3d75-4868-a5a2-9bb7a95cc290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:19 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Flow 'volume_create_manager' (6933506e-549d-4199-878c-584ba4ffd7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b4a1b9-dca5-4c4c-8bd5-928ee4d6670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:19 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-1338c91a-5fd2-4f20-b0b7-d79423b30863 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created volume successfully.
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b4a1b9-dca5-4c4c-8bd5-928ee4d6670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-965661256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e652eb-04a1-487f-bbf1-7736a4885f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f2db5ddd224c318d3da3bd69647534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:19Z,use_quota=True,user_id='8716d7735f87478397a672253e9c269e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c884f74-2fbb-4c80-a7c9-6c28e7f9ac84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c884f74-2fbb-4c80-a7c9-6c28e7f9ac84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c656cc62-c4b8-4571-b6c8-93ea1ec0ddb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c656cc62-c4b8-4571-b6c8-93ea1ec0ddb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6e652eb-04a1-487f-bbf1-7736a4885f24', 'volume_name': 'volume-f6e652eb-04a1-487f-bbf1-7736a4885f24', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55534aab-535e-4fe4-a75c-37927d3878fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55534aab-535e-4fe4-a75c-37927d3878fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1c09e3-57d9-4bc5-80c9-9bae0161c73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:19 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Volume f6e652eb-04a1-487f-bbf1-7736a4885f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6e652eb-04a1-487f-bbf1-7736a4885f24', 'volume_size': 1}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-965661256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e652eb-04a1-487f-bbf1-7736a4885f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f2db5ddd224c318d3da3bd69647534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:19Z,use_quota=True,user_id='8716d7735f87478397a672253e9c269e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Creating volume f6e652eb-04a1-487f-bbf1-7736a4885f24 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:33:19 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:33:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f6e652eb-04a1-487f-bbf1-7736a4885f24 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:19 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=92, name=volume-f6e652eb-04a1-487f-bbf1-7736a4885f24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" acquired by "delete_snapshot" :: waited 0.334s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Deleting offline snapshot aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 of volume ab8a0e4d-db5d-44c0-bb53-c414d68304ea {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] snapshot_file for this snap is: volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[447f7244-c9e0-4c57-affe-8b35856df6f0]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f6e652eb-04a1-487f-bbf1-7736a4885f24 1073741824" returned: 0 in 0.446s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f6e652eb-04a1-487f-bbf1-7736a4885f24 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f6e652eb-04a1-487f-bbf1-7736a4885f24" returned: 0 in 0.376s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] <== create_volume: return (959ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548" returned: 0 in 0.774s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1c09e3-57d9-4bc5-80c9-9bae0161c73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e652eb-04a1-487f-bbf1-7736a4885f24', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39c3eef-59cf-4e7c-a704-13305de2decb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e76339-9d71-4a07-8c4a-4cbf4afecf7f]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:21 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Volume volume-f6e652eb-04a1-487f-bbf1-7736a4885f24 (f6e652eb-04a1-487f-bbf1-7736a4885f24): created successfully
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39c3eef-59cf-4e7c-a704-13305de2decb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Flow 'volume_create_manager' (6933506e-549d-4199-878c-584ba4ffd7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:21 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-deedf600-54c4-4a57-98dd-714dbadce98a tempest-TestMinimumBasicScenario-1802021186 None] Created volume successfully.
Sep 16 11:33:21 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Creating offline snapshot 71499dde-660f-4ae1-b955-a8ca10547e1d of volume 480aef72-f2cf-4a24-9807-a12c07b596f7 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f25b85-931e-4f4a-966c-e775d0136910]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" returned: 0 in 1.148s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:22 devstack quobyte-client[83411]: System call of process 96521 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548" returned: 0 in 0.338s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7" returned: 0 in 1.013s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea.aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548" returned: 0 in 0.212s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:23 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=93, name=volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:33:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-aa4d1448-df22-4b2d-b6f8-d2f4fbfe2548" released by "_delete_snapshot" :: held 2.973s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:23 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" released by "delete_snapshot" :: held 3.051s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d 1G" returned: 0 in 0.412s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): qemu-img rebase -u -b volume-480aef72-f2cf-4a24-9807-a12c07b596f7 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:23 devstack quobyte-client[83411]: System call of process 96530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "qemu-img rebase -u -b volume-480aef72-f2cf-4a24-9807-a12c07b596f7 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d" returned: 0 in 0.367s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:33:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d" returned: 0 in 0.331s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:33:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d" returned: 0 in 0.292s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:24 devstack cinder-volume[83386]: WARNING cinder.quota [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-786245100 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-786245100, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:33:24 devstack cinder-volume[83386]: WARNING cinder.quota [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-786245100 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-786245100, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:33:24 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] Created reservations ['13819c41-84b6-4020-b9cd-85def4877311', 'd1a8454c-0683-47c0-a1b9-1225e34b5ad2', '8e5dd5c3-db3b-4920-927b-1e741c5ce6e6', 'c41990e0-a2ad-49c9-b7e4-d2be6063a6a4'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:33:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.info" returned: 0 in 0.495s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:33:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.info" returned: 0 in 0.230s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.417s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:25 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ba9be758-cdce-4b1d-86c6-4f1b520fd10b tempest-CreateVolumesFromSnapshotTest-1499177322 None] Create snapshot completed successfully
Sep 16 11:33:25 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-7bf729d3-8d24-43b7-b352-9d92db81944f tempest-GroupSnapshotsTest-869189185 None] group_snapshot 90a7907a-3983-4b85-bcef-90fd873a0657: deleted successfully
Sep 16 11:33:25 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:33:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:27 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:33:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (f1c13fee-b42c-423c-88bd-ff08e1cfe450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4092f9-8afd-4fcc-a515-377f8174571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:27 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:33:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (c623cd55-b7f9-4b04-ae2a-7a721a0669e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587ea0f8-e9b0-429d-b300-d021b0471b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 1.896s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:33:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:27 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (ed97f401-2b29-4ba1-a615-ede778ed6fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d992c493-071e-426b-8c5e-de3fcf332505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d992c493-071e-426b-8c5e-de3fcf332505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1713827351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6adb70e-1bb3-49f1-ad68-1e5a16497dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:28Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c4d6ff-2bb1-45e8-9152-65c0663aeb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c4d6ff-2bb1-45e8-9152-65c0663aeb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ec0d12-01e2-41fe-b961-b26d8ce884ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ec0d12-01e2-41fe-b961-b26d8ce884ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6adb70e-1bb3-49f1-ad68-1e5a16497dd5', 'volume_name': 'volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe90399-0ffd-406d-be63-7e6a92ae633a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe90399-0ffd-406d-be63-7e6a92ae633a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708611a9-ec6c-48f3-a856-0d4e38288842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:28 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume d6adb70e-1bb3-49f1-ad68-1e5a16497dd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5', 'volume_size': 1}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1713827351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6adb70e-1bb3-49f1-ad68-1e5a16497dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:28Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Creating volume d6adb70e-1bb3-49f1-ad68-1e5a16497dd5 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:33:28 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:28 devstack quobyte-client[83411]: System call of process 96547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-4c2ec7f3-6f67-4b61-bdd4-f1b58494a7f1 req-1879f2c5-8cda-45e5-8330-1fc6460dfce0 tempest-TestMinimumBasicScenario-1802021186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:28 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=95, name=volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4092f9-8afd-4fcc-a515-377f8174571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237122370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:26Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bbb489-e7a1-4d01-9bd0-99312447611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94bbb489-e7a1-4d01-9bd0-99312447611a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8062adb0-a302-4d8a-a2f4-968a4876f428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8062adb0-a302-4d8a-a2f4-968a4876f428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf', 'volume_name': 'volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bc602e-1495-49d6-b42d-c4b7af758d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bc602e-1495-49d6-b42d-c4b7af758d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4567d11d-0edd-4a28-934b-833b394e138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:28 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume 1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf', 'volume_size': 1}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587ea0f8-e9b0-429d-b300-d021b0471b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2020320583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d344ca1-6e89-454c-956b-c7499df3895a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:27Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4a4e1f-7a59-497e-be74-8a96d748ab99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4a4e1f-7a59-497e-be74-8a96d748ab99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ba58cd-c498-4c54-b4c4-5214f4c42a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ba58cd-c498-4c54-b4c4-5214f4c42a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d344ca1-6e89-454c-956b-c7499df3895a', 'volume_name': 'volume-9d344ca1-6e89-454c-956b-c7499df3895a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f459993f-a986-4b9b-9699-03caf9a3e655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f459993f-a986-4b9b-9699-03caf9a3e655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366b149d-dc67-47a4-af4a-90199c02c0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:29 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume 9d344ca1-6e89-454c-956b-c7499df3895a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d344ca1-6e89-454c-956b-c7499df3895a', 'volume_size': 1}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:29 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "cinder-quobyte-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5 1073741824" returned: 0 in 0.888s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:29 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (bab77c51-2a24-4dc2-97b8-3942c05bec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514ccf4c-28ed-42e9-b93e-7af1445089ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" acquired by "delete_volume" :: waited 0.736s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514ccf4c-28ed-42e9-b93e-7af1445089ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-254288857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afa7c4a-4b4d-4fb6-9367-c773c2aace3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:28Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0aa2d12-274a-42f7-96b0-81253b6b60c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0aa2d12-274a-42f7-96b0-81253b6b60c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf55ce06-6d23-4dee-92b3-e07d2063b0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf55ce06-6d23-4dee-92b3-e07d2063b0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2afa7c4a-4b4d-4fb6-9367-c773c2aace3b', 'volume_name': 'volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f36f4d-b6af-43f6-affb-11fb96a3da98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f36f4d-b6af-43f6-affb-11fb96a3da98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cca69a-db0f-4b87-9d89-2e399f1d41be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:29 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume 2afa7c4a-4b4d-4fb6-9367-c773c2aace3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b', 'volume_size': 1}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5" returned: 0 in 0.711s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d84d6b2-e31b-4b43-915b-2db46c4905b5]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] <== create_volume: return (1779ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:33:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-4c2ec7f3-6f67-4b61-bdd4-f1b58494a7f1 req-1879f2c5-8cda-45e5-8330-1fc6460dfce0 tempest-TestMinimumBasicScenario-1802021186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.832s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708611a9-ec6c-48f3-a856-0d4e38288842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1c567b-5855-4c18-aef0-41574abca97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:30 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[38235c81-70a6-4ae7-b08b-07181b9cde26]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:30 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:30 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:33:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (b3cdcdc7-14dc-47d2-8980-c16bd405d4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175c62eb-f3b7-4fe3-a47f-8e6cd3f8d63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-4c2ec7f3-6f67-4b61-bdd4-f1b58494a7f1 req-1879f2c5-8cda-45e5-8330-1fc6460dfce0 tempest-TestMinimumBasicScenario-1802021186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f6e652eb-04a1-487f-bbf1-7736a4885f24 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:31 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5 (d6adb70e-1bb3-49f1-ad68-1e5a16497dd5): created successfully
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1c567b-5855-4c18-aef0-41574abca97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (ed97f401-2b29-4ba1-a615-ede778ed6fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175c62eb-f3b7-4fe3-a47f-8e6cd3f8d63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2004676339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7177f9-08dd-4d03-8287-7530fb7fb600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:29Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe1152c-5072-4207-82c3-7b397212bdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe1152c-5072-4207-82c3-7b397212bdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08598794-1665-47d7-9bf5-b16574a5f9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08598794-1665-47d7-9bf5-b16574a5f9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7177f9-08dd-4d03-8287-7530fb7fb600', 'volume_name': 'volume-5a7177f9-08dd-4d03-8287-7530fb7fb600', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6526e337-5a77-4cba-a645-2133fcb8d691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6526e337-5a77-4cba-a645-2133fcb8d691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6be7126-e336-4524-8238-603333dabd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:31 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume 5a7177f9-08dd-4d03-8287-7530fb7fb600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7177f9-08dd-4d03-8287-7530fb7fb600', 'volume_size': 1}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" returned: 0 in 1.255s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:31 devstack quobyte-client[83411]: System call of process 96553 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:31 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-113ca026-2c70-4b4d-82fd-1ecc022347be tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created volume successfully.
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" returned: 0 in 0.327s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-4c2ec7f3-6f67-4b61-bdd4-f1b58494a7f1 req-1879f2c5-8cda-45e5-8330-1fc6460dfce0 tempest-TestMinimumBasicScenario-1802021186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f6e652eb-04a1-487f-bbf1-7736a4885f24" returned: 0 in 1.047s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-4c2ec7f3-6f67-4b61-bdd4-f1b58494a7f1 req-1879f2c5-8cda-45e5-8330-1fc6460dfce0 tempest-TestMinimumBasicScenario-1802021186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.438s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Lock "cinder-quobyte-ab8a0e4d-db5d-44c0-bb53-c414d68304ea" released by "delete_volume" :: held 1.890s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.160s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237122370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:26Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Creating volume 1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:33:31 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:33:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:32 devstack quobyte-client[83411]: System call of process 96559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:32 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=96, name=volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:33:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf 1073741824" returned: 0 in 0.530s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:32 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-4c2ec7f3-6f67-4b61-bdd4-f1b58494a7f1 req-1879f2c5-8cda-45e5-8330-1fc6460dfce0 tempest-TestMinimumBasicScenario-1802021186 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-f6e652eb-04a1-487f-bbf1-7736a4885f24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e974de35-8626-449d-9394-3093425d5f23', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:33:32 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-4c2ec7f3-6f67-4b61-bdd4-f1b58494a7f1 req-1879f2c5-8cda-45e5-8330-1fc6460dfce0 tempest-TestMinimumBasicScenario-1802021186 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf" returned: 0 in 0.443s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] <== create_volume: return (1023ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:33:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.978s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2020320583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d344ca1-6e89-454c-956b-c7499df3895a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:27Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Creating volume 9d344ca1-6e89-454c-956b-c7499df3895a {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:33:33 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d344ca1-6e89-454c-956b-c7499df3895a 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:33 devstack quobyte-client[83411]: System call of process 96563 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:33 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=97, name=volume-9d344ca1-6e89-454c-956b-c7499df3895a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4567d11d-0edd-4a28-934b-833b394e138b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030ad91a-2a0f-4420-8c36-552edb79aed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Created reservations ['ac007c15-bcfa-49b1-8fb8-5d16c692720c'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d344ca1-6e89-454c-956b-c7499df3895a 1073741824" returned: 0 in 0.669s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:33 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf (1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf): created successfully
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030ad91a-2a0f-4420-8c36-552edb79aed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (f1c13fee-b42c-423c-88bd-ff08e1cfe450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d344ca1-6e89-454c-956b-c7499df3895a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5f50a660-629b-4e22-b4f3-0d7a7b144147 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created volume successfully.
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d344ca1-6e89-454c-956b-c7499df3895a" returned: 0 in 0.508s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] <== create_volume: return (1278ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:34 devstack cinder-volume[83386]: WARNING cinder.quota [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-786245100 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-786245100, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.393s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-254288857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afa7c4a-4b4d-4fb6-9367-c773c2aace3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:28Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Creating volume 2afa7c4a-4b4d-4fb6-9367-c773c2aace3b {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:33:34 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:34 devstack quobyte-client[83411]: System call of process 96567 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:34 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=98, name=volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366b149d-dc67-47a4-af4a-90199c02c0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d344ca1-6e89-454c-956b-c7499df3895a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadc9f13-8140-4c93-8968-b40c91d0e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-4c2ec7f3-6f67-4b61-bdd4-f1b58494a7f1 req-1879f2c5-8cda-45e5-8330-1fc6460dfce0 tempest-TestMinimumBasicScenario-1802021186 None] attachment_update completed successfully.
Sep 16 11:33:34 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume volume-9d344ca1-6e89-454c-956b-c7499df3895a (9d344ca1-6e89-454c-956b-c7499df3895a): created successfully
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadc9f13-8140-4c93-8968-b40c91d0e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (c623cd55-b7f9-4b04-ae2a-7a721a0669e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:35 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fccc2b2b-1f0f-4588-ad78-a4eaa4df60b9 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created volume successfully.
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Created reservations ['4c3abb76-0d33-4625-9888-a17796fd64f2', '61099711-f3e2-446f-a391-0f8f6cfacda5', 'a7eb457e-4708-4a25-b7ca-e918d4f6de7c', '9a42a894-e952-4a30-b7af-92f3dcd7766d'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b 1073741824" returned: 0 in 0.687s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b" returned: 0 in 0.345s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] <== create_volume: return (1089ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.262s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2004676339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7177f9-08dd-4d03-8287-7530fb7fb600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='627190fa970d427c9066869bfa5eea84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:33:29Z,use_quota=True,user_id='85e3a660c0594c1581fa0fe4fb7f19d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Creating volume 5a7177f9-08dd-4d03-8287-7530fb7fb600 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:33:35 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:33:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5a7177f9-08dd-4d03-8287-7530fb7fb600 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:35 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=99, name=volume-5a7177f9-08dd-4d03-8287-7530fb7fb600, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:33:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cca69a-db0f-4b87-9d89-2e399f1d41be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c983861-a339-4cbb-abe1-07f4bca3fc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:36 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b (2afa7c4a-4b4d-4fb6-9367-c773c2aace3b): created successfully
Sep 16 11:33:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c983861-a339-4cbb-abe1-07f4bca3fc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (bab77c51-2a24-4dc2-97b8-3942c05bec28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5a7177f9-08dd-4d03-8287-7530fb7fb600 1073741824" returned: 0 in 1.019s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5a7177f9-08dd-4d03-8287-7530fb7fb600 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fe81a550-2ec5-4368-922d-2296695ac839 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created volume successfully.
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5a7177f9-08dd-4d03-8287-7530fb7fb600" returned: 0 in 0.563s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] <== create_volume: return (1682ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6be7126-e336-4524-8238-603333dabd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7177f9-08dd-4d03-8287-7530fb7fb600', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9503c65-e832-432c-ad6f-6a34618e636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:33:37 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume volume-5a7177f9-08dd-4d03-8287-7530fb7fb600 (5a7177f9-08dd-4d03-8287-7530fb7fb600): created successfully
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9503c65-e832-432c-ad6f-6a34618e636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Flow 'volume_create_manager' (b3cdcdc7-14dc-47d2-8980-c16bd405d4e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:33:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2ad270dd-680f-4d92-944c-f2554ba23c81 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created volume successfully.
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.206s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:37 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:33:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-4411bdcf-9777-44ae-80c8-615eece71367 tempest-GroupSnapshotsTest-869189185 None] Delete group completed successfully.
Sep 16 11:33:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-5a7177f9-08dd-4d03-8287-7530fb7fb600-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-5a7177f9-08dd-4d03-8287-7530fb7fb600-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:39 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=90,cinder:SELECT=83,cinder:INSERT=15,cinder:DELETE=6 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:33:39 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-quobyte-5a7177f9-08dd-4d03-8287-7530fb7fb600" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-5a7177f9-08dd-4d03-8287-7530fb7fb600" acquired by "delete_volume" :: waited 0.028s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:39 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[847f255c-4268-4031-acf5-7b77b7735028]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5a7177f9-08dd-4d03-8287-7530fb7fb600 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5a7177f9-08dd-4d03-8287-7530fb7fb600" returned: 0 in 0.853s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5a7177f9-08dd-4d03-8287-7530fb7fb600 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-5a7177f9-08dd-4d03-8287-7530fb7fb600" returned: 0 in 0.229s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:40 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-5a7177f9-08dd-4d03-8287-7530fb7fb600" released by "delete_volume" :: held 1.297s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:40 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=74,cinder:UPDATE=74,cinder:INSERT=15,cinder:DELETE=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:33:41 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created reservations ['16d2ed88-8e7e-45f6-839a-638626ae9dff', '6ab4c033-fbcb-450e-9bfd-58a74464e9ed', '915d5ded-c945-47c4-b8bd-f55c3e475661', '5fa6fbc8-5cb2-4362-8ef5-b173e91060d5'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:33:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:41 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:41 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.179s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:41 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:33:41 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Deleted volume successfully.
Sep 16 11:33:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5ee114d6-b0a6-4919-8cf2-22b75140eeef tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-5a7177f9-08dd-4d03-8287-7530fb7fb600-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b-delete_volume" acquired by "delete_volume" :: waited 0.193s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-quobyte-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b" acquired by "delete_volume" :: waited 0.019s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:43 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a69eda0-4efd-4eb8-8aa1-26def79c1be9]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:43 devstack quobyte-client[83411]: System call of process 96969 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:43 devstack quobyte-client[83411]: System call of process 96969 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b" returned: 0 in 0.980s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b" returned: 0 in 0.168s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b" released by "delete_volume" :: held 1.326s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:45 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created reservations ['348fca3b-57f2-4ccf-aca9-986a38ff1bfe', '478847f1-911c-464d-8b61-c99c8f30c47f', 'b72734e2-28cb-4140-8d66-33f9094e7830', 'f14023da-7693-40be-ae78-cf7ff9b547a6'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:33:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.289s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:46 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:33:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Deleted volume successfully.
Sep 16 11:33:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e62a27a5-4d4f-4147-b7a8-f1b6c4c4050a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-2afa7c4a-4b4d-4fb6-9367-c773c2aace3b-delete_volume" released by "delete_volume" :: held 4.689s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:47 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-quobyte-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5" acquired by "delete_volume" :: waited 0.020s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:47 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d412124-3098-4775-b1ed-6ef26c999769]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5" returned: 0 in 1.388s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5" returned: 0 in 0.385s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5" released by "delete_volume" :: held 2.284s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:50 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created reservations ['51c6d0bb-81b6-4c5f-9856-29e6d94ef936', '713af20a-e165-4a24-94aa-ba7d2292acba', 'f8a8e875-21f9-4d79-aeaa-67d0c6b0b609', '56636801-fae9-4131-bcec-c573c08f1f68'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:33:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.221s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:51 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:33:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-9d344ca1-6e89-454c-956b-c7499df3895a-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:52 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Deleted volume successfully.
Sep 16 11:33:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-9d344ca1-6e89-454c-956b-c7499df3895a-delete_volume" acquired by "delete_volume" :: waited 0.330s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-65868de3-c6dc-4355-a2e1-35658582fe42 tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-d6adb70e-1bb3-49f1-ad68-1e5a16497dd5-delete_volume" released by "delete_volume" :: held 5.684s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:53 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-quobyte-9d344ca1-6e89-454c-956b-c7499df3895a" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-9d344ca1-6e89-454c-956b-c7499df3895a" acquired by "delete_volume" :: waited 0.034s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:53 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc292933-6e44-4e92-beda-68b8c0c8a74a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d344ca1-6e89-454c-956b-c7499df3895a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:54 devstack quobyte-client[83411]: System call of process 97030 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:33:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d344ca1-6e89-454c-956b-c7499df3895a" returned: 0 in 1.476s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d344ca1-6e89-454c-956b-c7499df3895a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9d344ca1-6e89-454c-956b-c7499df3895a" returned: 0 in 0.715s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-9d344ca1-6e89-454c-956b-c7499df3895a" released by "delete_volume" :: held 2.843s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:57 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created reservations ['d69f50b5-63b6-4da7-9ac5-a4b426919b67', '4cabb8c7-4e34-4312-ac01-b35e678ff2e4', '5bee890e-4e03-44ed-9fe1-304181cbfb4d', '480e4f4a-6e66-41e8-84fa-37bddbe62c1e'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:33:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:33:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:33:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:33:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:33:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:33:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.216s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:33:57 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:33:58 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Deleted volume successfully.
Sep 16 11:33:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-33a54ddc-f860-432c-8c54-1b5c9349381a tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-9d344ca1-6e89-454c-956b-c7499df3895a-delete_volume" released by "delete_volume" :: held 5.822s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:33:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:58 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:33:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-quobyte-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:33:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf" acquired by "delete_volume" :: waited 0.017s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:33:58 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f519094-a388-4e89-a591-509dad2f7e03]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:33:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:33:59 devstack quobyte-client[83411]: System call of process 97093 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf" returned: 0 in 1.033s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf" returned: 0 in 0.281s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:00 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf" released by "delete_volume" :: held 1.717s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:01 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created reservations ['3ac092e6-3dd8-45ed-b52c-cf14d1ca23d8', '31d0549c-e497-4dbf-9bfd-ea4a3c86e978', '32269c92-d1be-457b-adfb-2d1f2ca3e16c', '213c1e37-ac6e-4418-af66-bc035b788603'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.228s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:02 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Deleted volume successfully.
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-71499dde-660f-4ae1-b955-a8ca10547e1d-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-71499dde-660f-4ae1-b955-a8ca10547e1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.093s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:02 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-quobyte-480aef72-f2cf-4a24-9807-a12c07b596f7" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8a706d93-0f16-45fb-b5cd-0d20ef010fdb tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-1ec7ad49-9fe9-44db-9e52-f2f821f3b8cf-delete_volume" released by "delete_volume" :: held 4.043s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-480aef72-f2cf-4a24-9807-a12c07b596f7" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-quobyte-71499dde-660f-4ae1-b955-a8ca10547e1d" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-71499dde-660f-4ae1-b955-a8ca10547e1d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Deleting offline snapshot 71499dde-660f-4ae1-b955-a8ca10547e1d of volume 480aef72-f2cf-4a24-9807-a12c07b596f7 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] snapshot_file for this snap is: volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bf6128-9e3b-46c1-b660-19e501b0924a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:03 devstack quobyte-client[83411]: System call of process 97106 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d" returned: 0 in 0.568s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-480aef72-f2cf-4a24-9807-a12c07b596f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:34:03 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ae1f5-9849-4e36-8073-c6b4ad1541af]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7" returned: 0 in 0.528s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d" returned: 0 in 0.260s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7.71499dde-660f-4ae1-b955-a8ca10547e1d" returned: 0 in 0.098s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-71499dde-660f-4ae1-b955-a8ca10547e1d" released by "_delete_snapshot" :: held 1.818s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-480aef72-f2cf-4a24-9807-a12c07b596f7" released by "delete_snapshot" :: held 1.848s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:04 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created reservations ['e72cb9da-daf2-4d29-a062-561196505fe5', '263b0613-4642-4ef3-8a20-4c4a332f97a9', '029252e6-9b75-4ca9-b4c1-eff49b84e0fe', '09610a39-826f-4a45-bf91-756bdc70eb3a'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:04 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-f30463fd-8753-40ab-9156-d5a7a93bba42 tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:04 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f30463fd-8753-40ab-9156-d5a7a93bba42 tempest-GroupsTest-1228308929 None] Group tempest-Group1-1349263572: creating
Sep 16 11:34:05 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f30463fd-8753-40ab-9156-d5a7a93bba42 tempest-GroupsTest-1228308929 None] Group tempest-Group1-1349263572: created successfully
Sep 16 11:34:05 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f30463fd-8753-40ab-9156-d5a7a93bba42 tempest-GroupsTest-1228308929 None] Create group completed successfully.
Sep 16 11:34:05 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Delete snapshot completed successfully.
Sep 16 11:34:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1e6ab5e5-4800-4af0-892b-6cc71d90083f tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-71499dde-660f-4ae1-b955-a8ca10547e1d-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-480aef72-f2cf-4a24-9807-a12c07b596f7-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-480aef72-f2cf-4a24-9807-a12c07b596f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:05 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "cinder-quobyte-480aef72-f2cf-4a24-9807-a12c07b596f7" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-480aef72-f2cf-4a24-9807-a12c07b596f7" acquired by "delete_volume" :: waited 0.012s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:05 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a84cf42-013f-45a7-9054-5197cc753dcc]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7" returned: 0 in 0.394s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-480aef72-f2cf-4a24-9807-a12c07b596f7" returned: 0 in 0.130s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-quobyte-480aef72-f2cf-4a24-9807-a12c07b596f7" released by "delete_volume" :: held 0.693s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:06 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ec6fee52-2e29-45c0-91ec-1dac25560935 tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ec6fee52-2e29-45c0-91ec-1dac25560935 tempest-GroupsTest-1228308929 None] Group tempest-Group2-1971054997: creating
Sep 16 11:34:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ec6fee52-2e29-45c0-91ec-1dac25560935 tempest-GroupsTest-1228308929 None] Group tempest-Group2-1971054997: created successfully
Sep 16 11:34:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ec6fee52-2e29-45c0-91ec-1dac25560935 tempest-GroupsTest-1228308929 None] Create group completed successfully.
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Created reservations ['0d5cca5d-63f5-4b66-bd4f-3916da3ceda1', '7523ff55-d6a5-4fdf-bd63-ab345b028ff1', '27d814ee-604f-48df-93ba-780b861da7dc', '528ec39c-88a3-4572-801b-843f09c0618c'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.125s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Deleted volume successfully.
Sep 16 11:34:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1d70aae2-0e09-4174-9617-ec6df90cc95c tempest-CreateVolumesFromSnapshotTest-1499177322 None] Lock "cinder-480aef72-f2cf-4a24-9807-a12c07b596f7-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:07 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:07 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Flow 'volume_create_manager' (8384083a-cd68-4bbe-b8b0-5c34a5f0946f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0912a858-f1de-441a-8cd3-911a2bbc8620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0912a858-f1de-441a-8cd3-911a2bbc8620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1265802961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3bfcd1e9-1bdd-4b18-bccb-326330904124,host='devstack@QuobyteHD#QuobyteHD',id=2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440cb30fb17340ef8f62c2f1b798b9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:08Z,use_quota=True,user_id='3da37797915f4ae8b3cbf12068544033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e747631-aa28-4c42-b67b-1b9c09ef6700),volume_type_id=7e747631-aa28-4c42-b67b-1b9c09ef6700)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94048cc1-95a6-41e3-82c3-0f194934ec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94048cc1-95a6-41e3-82c3-0f194934ec71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba0d3fe-583d-4df4-adb2-b473cde487ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba0d3fe-583d-4df4-adb2-b473cde487ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a', 'volume_name': 'volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae25eaa-8614-4adb-8e92-061bca006904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae25eaa-8614-4adb-8e92-061bca006904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8a9456-2303-4b47-b7ee-5e7246a22d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:08 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Volume 2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a', 'volume_size': 1}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3bfcd1e9-1bdd-4b18-bccb-326330904124,created_at=2025-09-16T09:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1265802961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3bfcd1e9-1bdd-4b18-bccb-326330904124,host='devstack@QuobyteHD#QuobyteHD',id=2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440cb30fb17340ef8f62c2f1b798b9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:08Z,use_quota=True,user_id='3da37797915f4ae8b3cbf12068544033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e747631-aa28-4c42-b67b-1b9c09ef6700),volume_type_id=7e747631-aa28-4c42-b67b-1b9c09ef6700)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Creating volume 2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:34:08 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:08 devstack quobyte-client[83411]: System call of process 97122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:08 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=100, name=volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a 1073741824" returned: 0 in 0.433s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a" returned: 0 in 0.136s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] <== create_volume: return (654ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:34:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:09 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8a9456-2303-4b47-b7ee-5e7246a22d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:09 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91760d22-5fb3-40b8-bffb-3cebeba0eb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:09 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Volume volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a (2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a): created successfully
Sep 16 11:34:09 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91760d22-5fb3-40b8-bffb-3cebeba0eb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:09 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Flow 'volume_create_manager' (8384083a-cd68-4bbe-b8b0-5c34a5f0946f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:09 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-336c6318-3b8e-49cc-b152-7f2bc24519c1 tempest-GroupsTest-1228308929 None] Created volume successfully.
Sep 16 11:34:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Acquiring lock "cinder-quobyte-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Lock "cinder-quobyte-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a" acquired by "delete_volume" :: waited 0.062s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c17e52-a0ce-40e5-b4ff-3c83791c9e2a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:34:11 devstack quobyte-client[83411]: System call of process 97128 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (5a3327b0-ff83-4d43-9ab9-20c506baa801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375dc464-de82-4820-91a0-20783b714963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375dc464-de82-4820-91a0-20783b714963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-675448422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d800eb4-2d97-4163-8569-1da273ab2cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:11Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4f2df5-56f8-4264-a6b0-3b317bb2a878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b4f2df5-56f8-4264-a6b0-3b317bb2a878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ae6d54-d40c-4ae1-93d5-d8f0bc593ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ae6d54-d40c-4ae1-93d5-d8f0bc593ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d800eb4-2d97-4163-8569-1da273ab2cb7', 'volume_name': 'volume-1d800eb4-2d97-4163-8569-1da273ab2cb7', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ec2eab-0465-43b5-8e97-8d36fb976d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ec2eab-0465-43b5-8e97-8d36fb976d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f988fb-22db-4361-9866-2080c4f06af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:11 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume 1d800eb4-2d97-4163-8569-1da273ab2cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d800eb4-2d97-4163-8569-1da273ab2cb7', 'volume_size': 1}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-675448422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d800eb4-2d97-4163-8569-1da273ab2cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:11Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Creating volume 1d800eb4-2d97-4163-8569-1da273ab2cb7 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:34:11 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:34:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1d800eb4-2d97-4163-8569-1da273ab2cb7 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a" returned: 0 in 0.897s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:12 devstack quobyte-client[83411]: System call of process 97131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:12 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=101, name=volume-1d800eb4-2d97-4163-8569-1da273ab2cb7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:34:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a" returned: 0 in 0.190s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:12 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Lock "cinder-quobyte-2e0f0c6d-0135-4b17-b5ae-8a3aacd24e8a" released by "delete_volume" :: held 1.316s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1d800eb4-2d97-4163-8569-1da273ab2cb7 1073741824" returned: 0 in 0.716s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1d800eb4-2d97-4163-8569-1da273ab2cb7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1d800eb4-2d97-4163-8569-1da273ab2cb7" returned: 0 in 0.272s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] <== create_volume: return (1026ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:34:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f988fb-22db-4361-9866-2080c4f06af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d800eb4-2d97-4163-8569-1da273ab2cb7', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e300ce-39be-43fb-b133-df03b04f8c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:13 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume volume-1d800eb4-2d97-4163-8569-1da273ab2cb7 (1d800eb4-2d97-4163-8569-1da273ab2cb7): created successfully
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e300ce-39be-43fb-b133-df03b04f8c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (5a3327b0-ff83-4d43-9ab9-20c506baa801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Created reservations ['1ecccc68-65d7-4193-ba9e-f39b5c9db7f3'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:13 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-13ceee24-6e72-45fb-96d4-464c5459b973 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created volume successfully.
Sep 16 11:34:13 devstack cinder-volume[83386]: WARNING cinder.quota [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-537172926 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-537172926, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:34:13 devstack cinder-volume[83386]: WARNING cinder.quota [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-537172926 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-537172926, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Created reservations ['78610b47-9100-46d1-a383-31ac3282edb5', '7e0589fb-b055-45cd-89e8-48a920072c59', '3b4dbaf2-58d3-486d-b4b2-4fad3cc0156e', 'b03ad9e6-9c89-41b4-b7c4-ae96e83f33c3'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.123s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:13 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:13 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2a306f72-f176-4032-93a5-78940970304c tempest-GroupsTest-1228308929 None] Delete group completed successfully.
Sep 16 11:34:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (30d4febc-ae26-4fe4-bfe7-3cb2bf53eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d0b6ec-6f14-4b3a-9bc5-dc31df76608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d0b6ec-6f14-4b3a-9bc5-dc31df76608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-654072213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bb2a64-3335-4e76-a9a9-9729fe42b809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:14Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21052d3c-657c-4b4f-b494-68a8c98bc8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21052d3c-657c-4b4f-b494-68a8c98bc8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (310017b7-45f6-4b06-b9e8-f2a16ec5ce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (310017b7-45f6-4b06-b9e8-f2a16ec5ce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bb2a64-3335-4e76-a9a9-9729fe42b809', 'volume_name': 'volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574081c8-3986-465a-b3e4-a84ae7827e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574081c8-3986-465a-b3e4-a84ae7827e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd6f6aa-e958-44d0-9aba-0d64d93e4b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:14 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume b4bb2a64-3335-4e76-a9a9-9729fe42b809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809', 'volume_size': 1}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-654072213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bb2a64-3335-4e76-a9a9-9729fe42b809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:14Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Creating volume b4bb2a64-3335-4e76-a9a9-9729fe42b809 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:34:14 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:34:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:15 devstack quobyte-client[83411]: System call of process 97144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:15 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=102, name=volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:34:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (b02a0df0-c361-47bc-92f6-5b1dce2a0979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56008d0d-dad4-4060-8358-0f2a247b9113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56008d0d-dad4-4060-8358-0f2a247b9113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1961246502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80b1d01-564d-4480-83fd-2525b721bbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:14Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb48a937-b868-4d84-9542-dfb96509f5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb48a937-b868-4d84-9542-dfb96509f5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9106c96-0d49-4ff8-a25e-14b08621f58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9106c96-0d49-4ff8-a25e-14b08621f58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f80b1d01-564d-4480-83fd-2525b721bbcc', 'volume_name': 'volume-f80b1d01-564d-4480-83fd-2525b721bbcc', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56cea4c-086d-456f-96f8-f7f3e52437dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56cea4c-086d-456f-96f8-f7f3e52437dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7849e857-3b6c-4bd1-812d-3d43c1382ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:15 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume f80b1d01-564d-4480-83fd-2525b721bbcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f80b1d01-564d-4480-83fd-2525b721bbcc', 'volume_size': 1}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809 1073741824" returned: 0 in 1.016s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:16 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (0a36d813-9e90-4b59-97cc-77b14a3fc068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52003c8-e51c-471a-81d1-c1d5ad47ceea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809" returned: 0 in 1.051s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] <== create_volume: return (2102ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1961246502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f80b1d01-564d-4480-83fd-2525b721bbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:14Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Creating volume f80b1d01-564d-4480-83fd-2525b721bbcc {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:34:16 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:34:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f80b1d01-564d-4480-83fd-2525b721bbcc 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:17 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=103, name=volume-f80b1d01-564d-4480-83fd-2525b721bbcc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52003c8-e51c-471a-81d1-c1d5ad47ceea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029725957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0793a88-62e7-4034-aa47-1555cb3a56ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:15Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2a52e0-01b5-414e-93a2-b922252b9bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2a52e0-01b5-414e-93a2-b922252b9bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324a341b-8d9d-478d-b5b1-81eee7422804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324a341b-8d9d-478d-b5b1-81eee7422804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0793a88-62e7-4034-aa47-1555cb3a56ba', 'volume_name': 'volume-c0793a88-62e7-4034-aa47-1555cb3a56ba', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32df4e96-28ac-4655-9a93-b46eb22a6040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32df4e96-28ac-4655-9a93-b46eb22a6040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab3f7c0-ecef-4394-b91d-270e81bdbc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:17 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume c0793a88-62e7-4034-aa47-1555cb3a56ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0793a88-62e7-4034-aa47-1555cb3a56ba', 'volume_size': 1}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] Created reservations ['eb273051-74b3-4961-8328-be75d29a432f'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:17 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (12cd0203-ab45-446a-8838-c873d6393085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdb631c-279b-497d-888f-84cef34fe463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd6f6aa-e958-44d0-9aba-0d64d93e4b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da33b96-6461-4af2-a0d3-57e2e1321774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f80b1d01-564d-4480-83fd-2525b721bbcc 1073741824" returned: 0 in 0.786s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f80b1d01-564d-4480-83fd-2525b721bbcc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdb631c-279b-497d-888f-84cef34fe463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935935660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3535c2b3-641d-4d67-a89c-c7f1afdcb625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:16Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033dee97-3492-480b-ac1c-38b59c51b164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033dee97-3492-480b-ac1c-38b59c51b164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90731356-f8bb-49a5-aa49-9991f5a6df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90731356-f8bb-49a5-aa49-9991f5a6df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3535c2b3-641d-4d67-a89c-c7f1afdcb625', 'volume_name': 'volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed2e490-2e1a-4f11-bec4-d3aae5a5030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed2e490-2e1a-4f11-bec4-d3aae5a5030a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865fb664-0b0a-43da-a95e-d835a4a59edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:18 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume 3535c2b3-641d-4d67-a89c-c7f1afdcb625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625', 'volume_size': 1}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (3a587062-b458-4c91-9749-13a6dfc5fa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf5a6ad-b0cb-41d1-b1af-d7d179421d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf5a6ad-b0cb-41d1-b1af-d7d179421d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056359613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145d1fb9-346a-4718-a6d1-7435986f4b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:17Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b058766-66b1-4a5b-ab25-b608fc0af32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b058766-66b1-4a5b-ab25-b608fc0af32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aef0f6f-a053-4855-9aa4-e29b35b09e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aef0f6f-a053-4855-9aa4-e29b35b09e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145d1fb9-346a-4718-a6d1-7435986f4b1c', 'volume_name': 'volume-145d1fb9-346a-4718-a6d1-7435986f4b1c', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff22b5c-fb9e-4443-9cdf-59d224f8672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eff22b5c-fb9e-4443-9cdf-59d224f8672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cb2bf3-2eb9-45e0-9c7c-6933c78ee0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:18 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume 145d1fb9-346a-4718-a6d1-7435986f4b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145d1fb9-346a-4718-a6d1-7435986f4b1c', 'volume_size': 1}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:18 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809 (b4bb2a64-3335-4e76-a9a9-9729fe42b809): created successfully
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da33b96-6461-4af2-a0d3-57e2e1321774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (30d4febc-ae26-4fe4-bfe7-3cb2bf53eeed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f80b1d01-564d-4480-83fd-2525b721bbcc" returned: 0 in 0.840s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] <== create_volume: return (1650ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.318s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029725957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0793a88-62e7-4034-aa47-1555cb3a56ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:15Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Creating volume c0793a88-62e7-4034-aa47-1555cb3a56ba {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:34:18 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0793a88-62e7-4034-aa47-1555cb3a56ba 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:18 devstack quobyte-client[83411]: System call of process 97161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:18 devstack quobyte-client[83411]: System call of process 97161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:18 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=104, name=volume-c0793a88-62e7-4034-aa47-1555cb3a56ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.079s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.077s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:19 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-02c2a0b4-6b57-4712-873d-bd76816a7b6b tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created volume successfully.
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7849e857-3b6c-4bd1-812d-3d43c1382ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f80b1d01-564d-4480-83fd-2525b721bbcc', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2a1416-954f-481e-bcec-5f417c0aad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:19 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume volume-f80b1d01-564d-4480-83fd-2525b721bbcc (f80b1d01-564d-4480-83fd-2525b721bbcc): created successfully
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2a1416-954f-481e-bcec-5f417c0aad67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (b02a0df0-c361-47bc-92f6-5b1dce2a0979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0793a88-62e7-4034-aa47-1555cb3a56ba 1073741824" returned: 0 in 1.032s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.650s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0793a88-62e7-4034-aa47-1555cb3a56ba {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:19 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:19 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-f0b7f4e5-54f3-4c1a-b0be-23aa54c33264 tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:19 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f0b7f4e5-54f3-4c1a-b0be-23aa54c33264 tempest-GroupsTest-1228308929 None] Group tempest-GroupsTest-Group-1797711604: creating
Sep 16 11:34:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-bd0521bf-e9f9-4616-9149-c7d794a3ce02 tempest-GroupsTest-1228308929 None] Delete group completed successfully.
Sep 16 11:34:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-dbbcc170-21b5-49d7-8454-1231adaca0eb tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created volume successfully.
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0793a88-62e7-4034-aa47-1555cb3a56ba" returned: 0 in 0.446s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] <== create_volume: return (1503ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.067s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935935660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3535c2b3-641d-4d67-a89c-c7f1afdcb625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:16Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Creating volume 3535c2b3-641d-4d67-a89c-c7f1afdcb625 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:34:20 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:20 devstack quobyte-client[83411]: System call of process 97166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:20 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=105, name=volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab3f7c0-ecef-4394-b91d-270e81bdbc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0793a88-62e7-4034-aa47-1555cb3a56ba', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36be8fe9-10db-4edd-96c4-c24b7ad50a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f0b7f4e5-54f3-4c1a-b0be-23aa54c33264 tempest-GroupsTest-1228308929 None] Group tempest-GroupsTest-Group-1797711604: created successfully
Sep 16 11:34:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f0b7f4e5-54f3-4c1a-b0be-23aa54c33264 tempest-GroupsTest-1228308929 None] Create group completed successfully.
Sep 16 11:34:20 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume volume-c0793a88-62e7-4034-aa47-1555cb3a56ba (c0793a88-62e7-4034-aa47-1555cb3a56ba): created successfully
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36be8fe9-10db-4edd-96c4-c24b7ad50a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (0a36d813-9e90-4b59-97cc-77b14a3fc068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625 1073741824" returned: 0 in 0.797s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:21 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-1888e318-5ecb-4c94-b4b7-eade8de025e8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created volume successfully.
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625" returned: 0 in 0.624s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] <== create_volume: return (1480ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.170s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056359613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145d1fb9-346a-4718-a6d1-7435986f4b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f764a5eff84835b3d8260d91496bb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:17Z,use_quota=True,user_id='7dd654ecac8d4c3c9e2dbda894406aab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Creating volume 145d1fb9-346a-4718-a6d1-7435986f4b1c {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:34:21 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-145d1fb9-346a-4718-a6d1-7435986f4b1c 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:21 devstack quobyte-client[83411]: System call of process 97171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:21 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:21 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=106, name=volume-145d1fb9-346a-4718-a6d1-7435986f4b1c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:34:21 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Flow 'volume_create_manager' (5e55c6eb-9928-467c-ad27-3fda26fcf6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10b76b4-4fa6-4714-9520-2b7452fb49de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (865fb664-0b0a-43da-a95e-d835a4a59edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a351bf4-ac83-44d7-873b-9845e4ae7d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c10b76b4-4fa6-4714-9520-2b7452fb49de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1243856852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a6b6a62-7938-4d89-b06d-023712dd0b52,host='devstack@QuobyteHD#QuobyteHD',id=dd33d36f-ee30-482d-90fe-cfcfc497a30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440cb30fb17340ef8f62c2f1b798b9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:21Z,use_quota=True,user_id='3da37797915f4ae8b3cbf12068544033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7517ed6-0202-4fe4-90b4-d5e9181cfdba),volume_type_id=f7517ed6-0202-4fe4-90b4-d5e9181cfdba)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a95ca39-290f-4783-9880-5af483292f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a95ca39-290f-4783-9880-5af483292f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01c2649-3d52-4e3f-8f41-b0c533559e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01c2649-3d52-4e3f-8f41-b0c533559e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd33d36f-ee30-482d-90fe-cfcfc497a30b', 'volume_name': 'volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab6483e-a5e5-491a-bbac-f4c6128d96dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab6483e-a5e5-491a-bbac-f4c6128d96dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97e43d9-40cd-4852-bf42-3417a5dbd5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:22 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Volume dd33d36f-ee30-482d-90fe-cfcfc497a30b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b', 'volume_size': 1}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-145d1fb9-346a-4718-a6d1-7435986f4b1c 1073741824" returned: 0 in 0.689s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:22 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625 (3535c2b3-641d-4d67-a89c-c7f1afdcb625): created successfully
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a351bf4-ac83-44d7-873b-9845e4ae7d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (12cd0203-ab45-446a-8838-c873d6393085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-145d1fb9-346a-4718-a6d1-7435986f4b1c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:22 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fc0d6e94-4f9a-4492-b3c8-516edc9b2f44 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created volume successfully.
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-145d1fb9-346a-4718-a6d1-7435986f4b1c" returned: 0 in 0.436s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] <== create_volume: return (1165ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.510s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6a6b6a62-7938-4d89-b06d-023712dd0b52,created_at=2025-09-16T09:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1243856852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a6b6a62-7938-4d89-b06d-023712dd0b52,host='devstack@QuobyteHD#QuobyteHD',id=dd33d36f-ee30-482d-90fe-cfcfc497a30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440cb30fb17340ef8f62c2f1b798b9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:21Z,use_quota=True,user_id='3da37797915f4ae8b3cbf12068544033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7517ed6-0202-4fe4-90b4-d5e9181cfdba),volume_type_id=f7517ed6-0202-4fe4-90b4-d5e9181cfdba)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Creating volume dd33d36f-ee30-482d-90fe-cfcfc497a30b {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:34:22 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:34:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:23 devstack quobyte-client[83411]: System call of process 97175 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:23 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=107, name=volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:34:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99cb2bf3-2eb9-45e0-9c7c-6933c78ee0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145d1fb9-346a-4718-a6d1-7435986f4b1c', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b57c23-a7d7-43b4-98b6-40ea47ce95d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b 1073741824" returned: 0 in 0.477s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:23 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume volume-145d1fb9-346a-4718-a6d1-7435986f4b1c (145d1fb9-346a-4718-a6d1-7435986f4b1c): created successfully
Sep 16 11:34:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b57c23-a7d7-43b4-98b6-40ea47ce95d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Flow 'volume_create_manager' (3a587062-b458-4c91-9749-13a6dfc5fa35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b" returned: 0 in 0.522s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:23 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-0ce5df18-eb38-4fa4-9a35-8e1ecf924bdd tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created volume successfully.
Sep 16 11:34:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] <== create_volume: return (1079ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:34:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97e43d9-40cd-4852-bf42-3417a5dbd5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bddb555-8970-4919-8954-a1a71f206150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-145d1fb9-346a-4718-a6d1-7435986f4b1c-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:24 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Volume volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b (dd33d36f-ee30-482d-90fe-cfcfc497a30b): created successfully
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bddb555-8970-4919-8954-a1a71f206150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Flow 'volume_create_manager' (5e55c6eb-9928-467c-ad27-3fda26fcf6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-145d1fb9-346a-4718-a6d1-7435986f4b1c-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-46ed9c96-1fae-4731-8321-206ce4c87780 tempest-GroupsTest-1228308929 None] Created volume successfully.
Sep 16 11:34:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-quobyte-145d1fb9-346a-4718-a6d1-7435986f4b1c" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-145d1fb9-346a-4718-a6d1-7435986f4b1c" acquired by "delete_volume" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[11441307-f340-4f0d-87c7-eff88e04cbee]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-145d1fb9-346a-4718-a6d1-7435986f4b1c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-145d1fb9-346a-4718-a6d1-7435986f4b1c" returned: 0 in 0.487s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-145d1fb9-346a-4718-a6d1-7435986f4b1c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-145d1fb9-346a-4718-a6d1-7435986f4b1c" returned: 0 in 0.136s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-145d1fb9-346a-4718-a6d1-7435986f4b1c" released by "delete_volume" :: held 0.799s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:25 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Flow 'volume_create_manager' (c3a4e82e-7a54-4c43-ab70-2a4d36db7498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf6bb87-17a5-47df-924b-4f9398a32d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbf6bb87-17a5-47df-924b-4f9398a32d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1571023893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a6b6a62-7938-4d89-b06d-023712dd0b52,host='devstack@QuobyteHD#QuobyteHD',id=f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440cb30fb17340ef8f62c2f1b798b9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:25Z,use_quota=True,user_id='3da37797915f4ae8b3cbf12068544033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7517ed6-0202-4fe4-90b4-d5e9181cfdba),volume_type_id=f7517ed6-0202-4fe4-90b4-d5e9181cfdba)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a24b40f-104e-45ab-a094-89ca4294dc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a24b40f-104e-45ab-a094-89ca4294dc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25711d67-a757-456d-8d91-754ec623059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25711d67-a757-456d-8d91-754ec623059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24', 'volume_name': 'volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1d1af5-8d73-4281-95ab-090d81030a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a1d1af5-8d73-4281-95ab-090d81030a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073579d0-e6b7-407d-a2ed-2b7bb50598fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:25 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Volume f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24', 'volume_size': 1}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6a6b6a62-7938-4d89-b06d-023712dd0b52,created_at=2025-09-16T09:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1571023893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6a6b6a62-7938-4d89-b06d-023712dd0b52,host='devstack@QuobyteHD#QuobyteHD',id=f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440cb30fb17340ef8f62c2f1b798b9f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:34:25Z,use_quota=True,user_id='3da37797915f4ae8b3cbf12068544033',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7517ed6-0202-4fe4-90b4-d5e9181cfdba),volume_type_id=f7517ed6-0202-4fe4-90b4-d5e9181cfdba)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Creating volume f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:34:25 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:34:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:25 devstack quobyte-client[83411]: System call of process 97183 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:26 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=108, name=volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created reservations ['2b0afd9e-a220-4fee-adfb-02223f5e9a44', '76f9cccc-881c-4e4f-9828-e32fe829f087', '3b99862e-1364-490b-8a85-bb42afd49c7f', '43a1747e-c134-469a-8916-cda729ae7a74'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.411s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24 1073741824" returned: 0 in 0.740s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24" returned: 0 in 0.318s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] <== create_volume: return (1103ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:34:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073579d0-e6b7-407d-a2ed-2b7bb50598fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390bb577-89a3-4f0c-b5dd-ffab92a2d1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:27 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Volume volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24 (f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24): created successfully
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390bb577-89a3-4f0c-b5dd-ffab92a2d1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Flow 'volume_create_manager' (c3a4e82e-7a54-4c43-ab70-2a4d36db7498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-3535c2b3-641d-4d67-a89c-c7f1afdcb625-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.755s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-778ce427-54db-4e4a-bed2-6455c301db89 tempest-GroupsTest-1228308929 None] Created volume successfully.
Sep 16 11:34:28 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Deleted volume successfully.
Sep 16 11:34:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-3535c2b3-641d-4d67-a89c-c7f1afdcb625-delete_volume" acquired by "delete_volume" :: waited 0.147s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-8c9dd03e-494e-4588-b830-bb37e41932f8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-145d1fb9-346a-4718-a6d1-7435986f4b1c-delete_volume" released by "delete_volume" :: held 3.921s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:28 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-quobyte-3535c2b3-641d-4d67-a89c-c7f1afdcb625" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:28 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-3535c2b3-641d-4d67-a89c-c7f1afdcb625" acquired by "delete_volume" :: waited 0.040s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:28 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-9304fd04-2a7d-4a95-8489-04a7bcb7160a tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:28 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e718c8e-8852-4b5b-a8cc-6657d4464df3]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:28 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-9304fd04-2a7d-4a95-8489-04a7bcb7160a tempest-GroupsTest-1228308929 None] Update group completed successfully.
Sep 16 11:34:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625" returned: 0 in 0.664s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3535c2b3-641d-4d67-a89c-c7f1afdcb625" returned: 0 in 0.134s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:29 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-3535c2b3-641d-4d67-a89c-c7f1afdcb625" released by "delete_volume" :: held 1.257s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:29 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-962a284d-97f3-46cc-b7a3-90bb5ff645b6 tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-962a284d-97f3-46cc-b7a3-90bb5ff645b6 tempest-GroupsTest-1228308929 None] Update group completed successfully.
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created reservations ['b4629a4a-7383-4d9a-b34a-10400373b9ce', '7bec9ea4-95a7-4424-bae6-4c7784981720', '15565644-9c31-44dc-bd82-a5832af73562', 'bc0e74b7-2e5a-4f84-afdd-5d7edaa4830f'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-c0793a88-62e7-4034-aa47-1555cb3a56ba-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-c0793a88-62e7-4034-aa47-1555cb3a56ba-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.572s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Deleted volume successfully.
Sep 16 11:34:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a5ba686c-6361-4593-b49d-3c032594e8b2 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-3535c2b3-641d-4d67-a89c-c7f1afdcb625-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:31 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-quobyte-c0793a88-62e7-4034-aa47-1555cb3a56ba" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-c0793a88-62e7-4034-aa47-1555cb3a56ba" acquired by "delete_volume" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:31 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[068b3fd5-7b25-4ef5-8084-c82d22459ed5]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0793a88-62e7-4034-aa47-1555cb3a56ba {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0793a88-62e7-4034-aa47-1555cb3a56ba" returned: 0 in 0.620s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0793a88-62e7-4034-aa47-1555cb3a56ba {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0793a88-62e7-4034-aa47-1555cb3a56ba" returned: 0 in 0.592s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:32 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-c0793a88-62e7-4034-aa47-1555cb3a56ba" released by "delete_volume" :: held 1.386s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Acquiring lock "cinder-quobyte-dd33d36f-ee30-482d-90fe-cfcfc497a30b" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Lock "cinder-quobyte-dd33d36f-ee30-482d-90fe-cfcfc497a30b" acquired by "delete_volume" :: waited 0.061s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:32 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cd84f8-3fba-4fc1-acef-f2a71d87631d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created reservations ['8abe334b-7669-4523-9429-daf9b6eb1b26', 'd93ece40-3cbd-4306-b953-43e885372488', '5f281005-220c-4af6-ae90-407d7f911b69', 'f90ab166-9361-423e-ab33-ee09dd7735e7'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:33 devstack quobyte-client[83411]: System call of process 97202 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b" returned: 0 in 0.878s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.338s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dd33d36f-ee30-482d-90fe-cfcfc497a30b" returned: 0 in 0.202s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:33 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Deleted volume successfully.
Sep 16 11:34:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Lock "cinder-quobyte-dd33d36f-ee30-482d-90fe-cfcfc497a30b" released by "delete_volume" :: held 1.540s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Acquiring lock "cinder-quobyte-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-f80b1d01-564d-4480-83fd-2525b721bbcc-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Lock "cinder-quobyte-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24" acquired by "delete_volume" :: waited 0.098s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dc1ca1bf-53a0-4e78-be0a-2b7a0ec122e9 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-c0793a88-62e7-4034-aa47-1555cb3a56ba-delete_volume" released by "delete_volume" :: held 3.674s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-f80b1d01-564d-4480-83fd-2525b721bbcc-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:34 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e811e8a-204b-4d3f-a080-5f95b2a2d4c6]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:34 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-quobyte-f80b1d01-564d-4480-83fd-2525b721bbcc" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-f80b1d01-564d-4480-83fd-2525b721bbcc" acquired by "delete_volume" :: waited 0.080s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:35 devstack quobyte-client[83411]: System call of process 97207 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:35 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f70333e-fe13-457e-9e12-5cb09d544b64]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f80b1d01-564d-4480-83fd-2525b721bbcc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24" returned: 0 in 0.859s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24" returned: 0 in 0.216s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Lock "cinder-quobyte-f32ca0f9-489c-4519-8eb9-6b0f2b8a4f24" released by "delete_volume" :: held 1.418s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:35 devstack quobyte-client[83411]: System call of process 97210 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:34:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f80b1d01-564d-4480-83fd-2525b721bbcc" returned: 0 in 0.851s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f80b1d01-564d-4480-83fd-2525b721bbcc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f80b1d01-564d-4480-83fd-2525b721bbcc" returned: 0 in 0.277s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-f80b1d01-564d-4480-83fd-2525b721bbcc" released by "delete_volume" :: held 1.352s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Created reservations ['3895351f-2373-44db-bdf9-43bb66ec2d63'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created reservations ['d63372af-0ca8-4f88-8432-61d44221065d', 'c5c0b797-10ae-4406-aac3-5f9ffaaab78c', 'c85e1c11-215b-4451-afea-d14a3bfe2756', 'e26df858-6533-426e-ba7c-c31fcf3109d5'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:36 devstack cinder-volume[83386]: WARNING cinder.quota [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1480129382 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1480129382, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:34:36 devstack cinder-volume[83386]: WARNING cinder.quota [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1480129382 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1480129382, it is now deprecated. Please use the default quota class for default quota.
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Created reservations ['ed75d282-920d-4c2d-9852-6fbcd4c65a6b', '7bae11f9-7a8b-4f20-a905-1d6e4d4ea4b5', 'b56198d4-610b-417f-90f9-2670c0f765f9', '6262557c-d33a-4077-811f-0f05aecd3f9a'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.335s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Deleted volume successfully.
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-711893c1-c5a6-4100-8e53-10fe2734d7a8 tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-f80b1d01-564d-4480-83fd-2525b721bbcc-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Created reservations ['8388c85e-9446-4c30-8c16-d087986138ad', 'e71e3c6e-d76b-48ac-94dc-05dbb432a680', 'd2bfe799-86f9-4375-8bb3-c3d60c1fb271', 'e0d9a961-5a64-498b-ad42-716464c71756'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-b4bb2a64-3335-4e76-a9a9-9729fe42b809-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-b4bb2a64-3335-4e76-a9a9-9729fe42b809-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:37 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-quobyte-b4bb2a64-3335-4e76-a9a9-9729fe42b809" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-b4bb2a64-3335-4e76-a9a9-9729fe42b809" acquired by "delete_volume" :: waited 0.282s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.323s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:38 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:38 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-74ca8410-edf4-41a4-a02b-8f823eefde3a tempest-GroupsTest-1228308929 None] Delete group completed successfully.
Sep 16 11:34:38 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6775fc8-1740-4036-a71b-3cd4d65d6b1f]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809" returned: 0 in 0.598s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4bb2a64-3335-4e76-a9a9-9729fe42b809" returned: 0 in 0.097s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-b4bb2a64-3335-4e76-a9a9-9729fe42b809" released by "delete_volume" :: held 1.072s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:39 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created reservations ['e1259360-ebb8-458e-b4f2-96d442148652', '37b8b075-7067-4778-af63-3094855d4700', '98d69cf6-8a1c-4c8a-a616-7660eda85d6f', 'cbdd643c-b37a-4859-861a-1607b8227d7c'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.169s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:39 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:40 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Deleted volume successfully.
Sep 16 11:34:41 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=103,cinder:UPDATE=157,cinder:DELETE=8,cinder:INSERT=39 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:34:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-1d800eb4-2d97-4163-8569-1da273ab2cb7-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8177d7a-f45c-4343-968f-733d84a5c39e tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-b4bb2a64-3335-4e76-a9a9-9729fe42b809-delete_volume" released by "delete_volume" :: held 4.026s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-1d800eb4-2d97-4163-8569-1da273ab2cb7-delete_volume" acquired by "delete_volume" :: waited 0.466s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:41 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=107,cinder:INSERT=24,cinder:UPDATE=139,cinder:DELETE=12 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:34:41 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "cinder-quobyte-1d800eb4-2d97-4163-8569-1da273ab2cb7" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:34:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-1d800eb4-2d97-4163-8569-1da273ab2cb7" acquired by "delete_volume" :: waited 0.026s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:34:42 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee728540-513a-4b3b-89eb-640d00e1696e]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:34:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1d800eb4-2d97-4163-8569-1da273ab2cb7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1d800eb4-2d97-4163-8569-1da273ab2cb7" returned: 0 in 0.706s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1d800eb4-2d97-4163-8569-1da273ab2cb7 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1d800eb4-2d97-4163-8569-1da273ab2cb7" returned: 0 in 0.250s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:43 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-quobyte-1d800eb4-2d97-4163-8569-1da273ab2cb7" released by "delete_volume" :: held 1.260s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:43 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Created reservations ['be9eeb5e-76d3-4e9a-adab-185ca15f5d8e', 'a98da652-6487-4c5d-9235-53c14db7f871', 'e8017607-bd42-4d3a-afd0-1b560eafaec1', '70b0124e-a579-4132-9059-6a18119e7f79'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:43 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:43 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.390s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:44 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:45 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Deleted volume successfully.
Sep 16 11:34:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-395adefd-6f87-4b68-8aed-f600ef0cb24f tempest-CreateVolumesFromSourceVolumeTest-536441159 None] Lock "cinder-1d800eb4-2d97-4163-8569-1da273ab2cb7-delete_volume" released by "delete_volume" :: held 3.858s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:34:50 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-73fca166-72ca-491c-8bbd-97324abe6ef3 tempest-GroupsV320Test-1620415227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:50 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-73fca166-72ca-491c-8bbd-97324abe6ef3 tempest-GroupsV320Test-1620415227 None] Group tempest-GroupsV320Test-Group-724345323: creating
Sep 16 11:34:50 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-73fca166-72ca-491c-8bbd-97324abe6ef3 tempest-GroupsV320Test-1620415227 None] Group tempest-GroupsV320Test-Group-724345323: created successfully
Sep 16 11:34:50 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-73fca166-72ca-491c-8bbd-97324abe6ef3 tempest-GroupsV320Test-1620415227 None] Create group completed successfully.
Sep 16 11:34:52 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:34:52 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] Created reservations ['b91bcf5d-ef18-4511-9090-a39da392a1df'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:34:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:34:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:34:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:34:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:34:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:34:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:34:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.248s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:34:53 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:34:53 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fc1515b0-9427-4ea8-a3c2-121ab7815897 tempest-GroupsV320Test-1620415227 None] Delete group completed successfully.
Sep 16 11:35:02 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Flow 'volume_create_manager' (08437825-acd7-4040-9330-971975a3ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe18dd6f-30f8-4c2c-b524-764cf62693c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe18dd6f-30f8-4c2c-b524-764cf62693c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1660831628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7900bbd3-ea64-453a-a939-01b9e7612a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7f898d458848e09f1defd8af03a250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:35:02Z,use_quota=True,user_id='cd0f29309840493d8f0d6a0730501ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2699e81-ff75-4b29-8ea0-3c633d819aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2699e81-ff75-4b29-8ea0-3c633d819aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099beff5-3668-47d2-87eb-347065ac0a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099beff5-3668-47d2-87eb-347065ac0a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7900bbd3-ea64-453a-a939-01b9e7612a4b', 'volume_name': 'volume-7900bbd3-ea64-453a-a939-01b9e7612a4b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c8cf28-9fd6-4d74-bd64-18fdcb96bb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c8cf28-9fd6-4d74-bd64-18fdcb96bb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fc0356-9412-4b97-8d85-2b2f6e522b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:02 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Volume 7900bbd3-ea64-453a-a939-01b9e7612a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7900bbd3-ea64-453a-a939-01b9e7612a4b', 'volume_size': 1}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1660831628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7900bbd3-ea64-453a-a939-01b9e7612a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d7f898d458848e09f1defd8af03a250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:35:02Z,use_quota=True,user_id='cd0f29309840493d8f0d6a0730501ab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Creating volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:35:02 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:35:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:03 devstack quobyte-client[83411]: System call of process 97394 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:03 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=109, name=volume-7900bbd3-ea64-453a-a939-01b9e7612a4b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:35:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b 1073741824" returned: 0 in 0.548s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b" returned: 0 in 0.393s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:04 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] <== create_volume: return (1094ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:35:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15fc0356-9412-4b97-8d85-2b2f6e522b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7900bbd3-ea64-453a-a939-01b9e7612a4b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5be0735-a2b4-4cd2-bee7-4e85eba96a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:04 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Volume volume-7900bbd3-ea64-453a-a939-01b9e7612a4b (7900bbd3-ea64-453a-a939-01b9e7612a4b): created successfully
Sep 16 11:35:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5be0735-a2b4-4cd2-bee7-4e85eba96a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Flow 'volume_create_manager' (08437825-acd7-4040-9330-971975a3ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:35:04 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-cdd4fe2e-b2e8-4a99-a03e-12301678b98f tempest-SnapshotsActionsTest-663976274 None] Created volume successfully.
Sep 16 11:35:05 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Creating offline snapshot b1ee079d-d764-4693-b708-b12bb954c602 of volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:35:06 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09a37f7-763b-43f3-8dd6-473e0f4e724b]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b" returned: 0 in 0.912s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:07 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=110, name=volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:35:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 1G" returned: 0 in 0.285s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7900bbd3-ea64-453a-a939-01b9e7612a4b -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img rebase -u -b volume-7900bbd3-ea64-453a-a939-01b9e7612a4b -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.272s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:07 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:35:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.137s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:07 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:35:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.138s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.info" returned: 0 in 0.161s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:35:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.info" returned: 0 in 0.180s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.570s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:08 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-19f9cd20-78f1-4f9b-8146-1f468762cea7 tempest-SnapshotsActionsTest-663976274 None] Create snapshot completed successfully
Sep 16 11:35:10 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Creating offline snapshot 2ff30856-4819-44e8-ad33-36d3109444c8 of volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:35:10 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c81950-b22c-4d49-9eaa-ecc4a50a9a04]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.741s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:11 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=112, name=volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:35:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8 1G" returned: 0 in 0.353s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:12 devstack quobyte-client[83411]: System call of process 97419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img rebase -u -b volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8" returned: 0 in 0.230s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:35:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8" returned: 0 in 0.144s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:35:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8" returned: 0 in 0.224s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:13 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-341fc167-4cb0-40e9-848a-ede9a2f21b39 tempest-SnapshotsActionsTest-663976274 None] Create snapshot completed successfully
Sep 16 11:35:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-2ff30856-4819-44e8-ad33-36d3109444c8-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-2ff30856-4819-44e8-ad33-36d3109444c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-quobyte-2ff30856-4819-44e8-ad33-36d3109444c8" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-2ff30856-4819-44e8-ad33-36d3109444c8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Deleting offline snapshot 2ff30856-4819-44e8-ad33-36d3109444c8 of volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] snapshot_file for this snap is: volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6bc49a-8979-49a6-95e2-b518c298c5ae]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:14 devstack quobyte-client[83411]: System call of process 97424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:14 devstack quobyte-client[83411]: System call of process 97424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8" returned: 0 in 0.686s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4e66d6-6be7-445e-b543-bb86da4331bf]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.503s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8" returned: 0 in 0.335s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.2ff30856-4819-44e8-ad33-36d3109444c8" returned: 0 in 0.146s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-2ff30856-4819-44e8-ad33-36d3109444c8" released by "_delete_snapshot" :: held 2.052s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" released by "delete_snapshot" :: held 2.097s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:17 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Created reservations ['a88005ae-fa1f-4118-980f-46c1736581ff', '553b5c66-c4f4-4579-8aa6-6daadfea3ed2', 'f0e8fa00-728e-4b64-ad0b-33c181f94fa1', '7f804067-00ff-4bfb-a795-e21da785771d'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:35:17 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Delete snapshot completed successfully.
Sep 16 11:35:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab3040fd-f91e-42fe-828a-a45290f03859 tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-2ff30856-4819-44e8-ad33-36d3109444c8-delete_snapshot" released by "delete_snapshot" :: held 3.608s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:19 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Creating offline snapshot 0cc034f8-2d3e-4eac-a55b-fc796368121b of volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:35:19 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f19425-5f41-43d3-ae04-a3c9ee1563ce]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:20 devstack quobyte-client[83411]: System call of process 97450 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.821s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:20 devstack quobyte-client[83411]: System call of process 97453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:20 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=113, name=volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:35:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b 1G" returned: 0 in 0.493s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img rebase -u -b volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b" returned: 0 in 0.182s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:35:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b" returned: 0 in 0.130s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:35:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b" returned: 0 in 0.116s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.251s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:21 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-dce9cd2e-4f47-4ca8-9f6a-f1874b1f46e3 tempest-SnapshotsActionsTest-663976274 None] Create snapshot completed successfully
Sep 16 11:35:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-0cc034f8-2d3e-4eac-a55b-fc796368121b-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-0cc034f8-2d3e-4eac-a55b-fc796368121b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.135s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:22 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-quobyte-0cc034f8-2d3e-4eac-a55b-fc796368121b" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-0cc034f8-2d3e-4eac-a55b-fc796368121b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Deleting offline snapshot 0cc034f8-2d3e-4eac-a55b-fc796368121b of volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:35:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] snapshot_file for this snap is: volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:35:22 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1701eb-7551-4129-b57c-5105913ceac2]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b" returned: 0 in 0.532s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:23 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89cf31f-0183-4bbb-96dd-30bc8c34d97a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.982s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:24 devstack quobyte-client[83411]: System call of process 97468 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b" returned: 0 in 0.536s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.0cc034f8-2d3e-4eac-a55b-fc796368121b" returned: 0 in 0.145s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-0cc034f8-2d3e-4eac-a55b-fc796368121b" released by "_delete_snapshot" :: held 2.607s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" released by "delete_snapshot" :: held 2.639s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:25 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Created reservations ['8e1a44e2-72db-43f1-8e41-ec44430bf4b1', 'a6fd24d0-c301-4d32-97d6-d4c555f94fa7', '8aa3b702-1794-46cf-950b-4166e453514f', '730f2d30-a0ff-41e6-a074-80d38eaafb21'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:35:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:35:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:35:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:35:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.374s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:35:26 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Delete snapshot completed successfully.
Sep 16 11:35:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-7a98285d-ce02-485d-80e8-f3ddfc9595ad tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-0cc034f8-2d3e-4eac-a55b-fc796368121b-delete_snapshot" released by "delete_snapshot" :: held 3.972s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Flow 'volume_create_manager' (353bc78c-f6ec-49a6-81e1-f6f4c78827f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f33f4ef-9c3d-44ad-bb36-60f10bac0a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f33f4ef-9c3d-44ad-bb36-60f10bac0a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1240958770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5c9086-162d-4ff7-9ff8-3840e8391c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d899f8bb9b024f70a24a6f1365aacadf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:35:27Z,use_quota=True,user_id='9d29a6a0ca4e40bb87e6d3a236d4d923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9254c900-afec-402a-ae8d-c8d5570132d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9254c900-afec-402a-ae8d-c8d5570132d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79dbaa5c-18b9-4f14-b01e-f83ba17389bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79dbaa5c-18b9-4f14-b01e-f83ba17389bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5c9086-162d-4ff7-9ff8-3840e8391c61', 'volume_name': 'volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc08eb0c-ef64-4529-99c4-c41da7f2d7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc08eb0c-ef64-4529-99c4-c41da7f2d7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61319d1d-dd5b-459b-bea1-fdc7104b5de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:27 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Volume 3a5c9086-162d-4ff7-9ff8-3840e8391c61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61', 'volume_size': 1}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1240958770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5c9086-162d-4ff7-9ff8-3840e8391c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d899f8bb9b024f70a24a6f1365aacadf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:35:27Z,use_quota=True,user_id='9d29a6a0ca4e40bb87e6d3a236d4d923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Creating volume 3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:35:27 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:35:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:27 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=114, name=volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 1073741824" returned: 0 in 0.744s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:28 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61" returned: 0 in 0.200s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] <== create_volume: return (975ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.115s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Creating offline snapshot c45410dd-eb78-4e33-888a-0effa6e01815 of volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61319d1d-dd5b-459b-bea1-fdc7104b5de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea40d874-59b6-4e5e-83dd-6295d514d9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d28e9d5-2691-4d49-b556-b595c7a41f65]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:28 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Volume volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 (3a5c9086-162d-4ff7-9ff8-3840e8391c61): created successfully
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea40d874-59b6-4e5e-83dd-6295d514d9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Flow 'volume_create_manager' (353bc78c-f6ec-49a6-81e1-f6f4c78827f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:35:28 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-0aecc903-6d8b-4e5b-8b6e-d2ea5cc99435 tempest-SnapshotDependencyTests-248013483 None] Created volume successfully.
Sep 16 11:35:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.628s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:29 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=115, name=volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:35:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815 1G" returned: 0 in 0.381s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img rebase -u -b volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815" returned: 0 in 0.376s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:30 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815" returned: 0 in 0.207s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815" returned: 0 in 0.109s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.274s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Creating offline snapshot 84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc of volume 3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[512985fd-28ad-45db-aced-5d0c796d8a78]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-adc5a637-333e-4c34-914b-64b1ef3fcc4a tempest-SnapshotsActionsTest-663976274 None] Create snapshot completed successfully
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-c45410dd-eb78-4e33-888a-0effa6e01815-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61" returned: 0 in 0.614s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:31 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=116, name=volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-c45410dd-eb78-4e33-888a-0effa6e01815-delete_snapshot" acquired by "delete_snapshot" :: waited 0.242s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:31 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc 1G" returned: 0 in 0.296s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" acquired by "delete_snapshot" :: waited 0.172s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-quobyte-c45410dd-eb78-4e33-888a-0effa6e01815" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] CMD "qemu-img rebase -u -b volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc" returned: 0 in 0.230s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-c45410dd-eb78-4e33-888a-0effa6e01815" acquired by "_delete_snapshot" :: waited 0.217s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Deleting offline snapshot c45410dd-eb78-4e33-888a-0effa6e01815 of volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] snapshot_file for this snap is: volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc" returned: 0 in 0.204s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b10dffc-52d0-400e-b9f0-72e6ae81bc36]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc" returned: 0 in 0.193s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.info" returned: 0 in 0.115s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.info" returned: 0 in 0.087s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815" returned: 0 in 0.679s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9fdb05-3d84-47e6-bf11-943ea0bafad3]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:32 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3392b321-4c1f-4eb1-bb32-1553518e6f4e tempest-SnapshotDependencyTests-248013483 None] Create snapshot completed successfully
Sep 16 11:35:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.452s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815" returned: 0 in 0.179s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.c45410dd-eb78-4e33-888a-0effa6e01815" returned: 0 in 0.084s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-c45410dd-eb78-4e33-888a-0effa6e01815" released by "_delete_snapshot" :: held 1.748s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" released by "delete_snapshot" :: held 2.034s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Created reservations ['b2756c93-6b2e-4532-948a-6518b1c781f1', '2edfea74-026a-4e97-ae7e-ab12b7695883', '92f3cd37-4ee2-4fb9-8b56-f4eb29ad3e4b', '8c95d0b0-ca55-49a9-aa5c-eec0c4568310'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:35:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Delete snapshot completed successfully.
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-299e1f7c-76b2-4840-9e55-7774732ea43c tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-c45410dd-eb78-4e33-888a-0effa6e01815-delete_snapshot" released by "delete_snapshot" :: held 2.724s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:34 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Flow 'volume_create_manager' (fd2bf330-7ed6-4ca8-a42e-3c64d5b15d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ed2362-f13c-4653-ba5b-43e74c72b457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ed2362-f13c-4653-ba5b-43e74c72b457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0861857-9c6a-4444-b45b-804bf490d631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d899f8bb9b024f70a24a6f1365aacadf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:35:34Z,use_quota=True,user_id='9d29a6a0ca4e40bb87e6d3a236d4d923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d8ed4f-88cb-443b-8949-10e132950a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d8ed4f-88cb-443b-8949-10e132950a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6185bf1a-c648-404b-8211-ce21bb76a08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6185bf1a-c648-404b-8211-ce21bb76a08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0861857-9c6a-4444-b45b-804bf490d631', 'volume_name': 'volume-c0861857-9c6a-4444-b45b-804bf490d631', 'volume_size': 1, 'snapshot_id': '84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc'}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86e6cae-a8af-44f7-8595-45c49c8ae2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86e6cae-a8af-44f7-8595-45c49c8ae2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ace54f4-318f-447f-b3c5-c37843c3671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:34 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Volume c0861857-9c6a-4444-b45b-804bf490d631: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0861857-9c6a-4444-b45b-804bf490d631', 'volume_size': 1, 'snapshot_id': '84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc'}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "cinder-quobyte-84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc-c0861857-9c6a-4444-b45b-804bf490d631" by "_create_volume_from_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc-c0861857-9c6a-4444-b45b-804bf490d631" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Creating volume c0861857-9c6a-4444-b45b-804bf490d631 from snapshot 84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc {{(pid=83386) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "cinder-quobyte-c0861857-9c6a-4444-b45b-804bf490d631" by "_copy_volume_from_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-c0861857-9c6a-4444-b45b-804bf490d631" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] snapshot: 84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc, volume: c0861857-9c6a-4444-b45b-804bf490d631,  {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 16 11:35:34 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4a51ed-1d97-48cf-9429-9a6eb8118d1a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc" returned: 0 in 0.376s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 16 11:35:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Creating direct copy from snapshot {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 16 11:35:35 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[513cd9eb-5d3a-4e2c-8c3b-1a422c1cc43a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61" returned: 0 in 0.414s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:35 devstack cinder-volume[83386]: DEBUG cinder.utils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631 not found in is_blk_device check {{(pid=83386) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 16 11:35:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:35 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=118, name=volume-c0861857-9c6a-4444-b45b-804bf490d631, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631" returned: 0 in 6.253s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bdc3ca-7835-4db3-a7a7-95d646dba4af]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61" returned: 0 in 0.562s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Image conversion details: src /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631 {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:35:42 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Converted 1024.00 MB image at 162.94 MB/s
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631" returned: 0 in 0.108s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-c0861857-9c6a-4444-b45b-804bf490d631" released by "_copy_volume_from_snapshot" :: held 8.075s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc-c0861857-9c6a-4444-b45b-804bf490d631" released by "_create_volume_from_snapshot" :: held 8.127s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.158s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.190s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:43 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=38,cinder:UPDATE=41,cinder:DELETE=5,cinder:INSERT=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:35:43 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=35,cinder:SELECT=37,cinder:INSERT=15,cinder:DELETE=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:35:43 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Creating offline snapshot 6b742374-c9cf-4118-a50e-4e73981f7559 of volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:35:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ace54f4-318f-447f-b3c5-c37843c3671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0861857-9c6a-4444-b45b-804bf490d631', 'volume_size': 1, 'snapshot_id': '84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc'}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea6faee-bec7-4f8f-a658-05cfe6de97d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:35:43 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[886b739a-81df-4eda-89af-b66e97836bd8]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:43 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Volume volume-c0861857-9c6a-4444-b45b-804bf490d631 (c0861857-9c6a-4444-b45b-804bf490d631): created successfully
Sep 16 11:35:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea6faee-bec7-4f8f-a658-05cfe6de97d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:35:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Flow 'volume_create_manager' (fd2bf330-7ed6-4ca8-a42e-3c64d5b15d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:35:43 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-f3556921-1035-4913-9654-994d6bfd1107 tempest-SnapshotDependencyTests-248013483 None] Created volume successfully.
Sep 16 11:35:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.729s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:44 devstack quobyte-client[83411]: System call of process 97547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:44 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=119, name=volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:35:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559 1G" returned: 0 in 0.428s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:44 devstack quobyte-client[83411]: System call of process 97553 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "cinder-84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img rebase -u -b volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559" returned: 0 in 0.463s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.113s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:45 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "cinder-quobyte-3a5c9086-162d-4ff7-9ff8-3840e8391c61" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559" returned: 0 in 0.232s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-3a5c9086-162d-4ff7-9ff8-3840e8391c61" acquired by "delete_snapshot" :: waited 0.418s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "cinder-quobyte-84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559" returned: 0 in 0.330s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc" acquired by "_delete_snapshot" :: waited 0.280s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Deleting offline snapshot 84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc of volume 3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:35:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] snapshot_file for this snap is: volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:35:46 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[9014a16e-87f1-4158-b1b2-ba8bfdea39af]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-0052a68c-948c-4dd6-95da-9ce6c3b62670 tempest-SnapshotsActionsTest-663976274 None] Create snapshot completed successfully
Sep 16 11:35:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc" returned: 0 in 0.783s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:46 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c057321-dc7f-48a9-b50c-8e73e66eb0b3]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:47 devstack quobyte-client[83411]: System call of process 97572 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-6b742374-c9cf-4118-a50e-4e73981f7559-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61" returned: 0 in 1.102s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-6b742374-c9cf-4118-a50e-4e73981f7559-delete_snapshot" acquired by "delete_snapshot" :: waited 0.580s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:48 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" acquired by "delete_snapshot" :: waited 0.049s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Acquiring lock "cinder-quobyte-6b742374-c9cf-4118-a50e-4e73981f7559" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-6b742374-c9cf-4118-a50e-4e73981f7559" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Deleting offline snapshot 6b742374-c9cf-4118-a50e-4e73981f7559 of volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] snapshot_file for this snap is: volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc" returned: 0 in 0.586s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09acf6e-9b1e-48b0-a97d-20f518314ac2]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61.84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc" returned: 0 in 0.292s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc" released by "_delete_snapshot" :: held 3.259s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-3a5c9086-162d-4ff7-9ff8-3840e8391c61" released by "delete_snapshot" :: held 3.628s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:49 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Created reservations ['e9038c7a-bbd8-47ca-b0fa-455508348daf', 'e3fb0727-c401-4291-a5d3-8cac243d5962', '63dd4849-ff91-42d4-83c3-0bfce01c1016', 'ee7572ee-28ea-46d5-a7a2-ec05a17734df'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:35:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559" returned: 0 in 0.709s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:49 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb59f1fe-6392-44d2-9b2c-903710ce30c3]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "cinder-3a5c9086-162d-4ff7-9ff8-3840e8391c61-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.957s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:50 devstack quobyte-client[83411]: System call of process 97589 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:50 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Delete snapshot completed successfully.
Sep 16 11:35:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-065de372-9f4e-4b8a-84d5-0e76b2c29a62 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-84b0ba8f-92db-4aa9-b7a9-f8702b02b1cc-delete_snapshot" released by "delete_snapshot" :: held 5.869s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:50 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-3a5c9086-162d-4ff7-9ff8-3840e8391c61-delete_volume" acquired by "delete_volume" :: waited 0.490s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559" returned: 0 in 0.542s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.6b742374-c9cf-4118-a50e-4e73981f7559" returned: 0 in 0.359s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:51 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "cinder-quobyte-3a5c9086-162d-4ff7-9ff8-3840e8391c61" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:51 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-6b742374-c9cf-4118-a50e-4e73981f7559" released by "_delete_snapshot" :: held 3.054s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:51 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-3a5c9086-162d-4ff7-9ff8-3840e8391c61" acquired by "delete_volume" :: waited 0.057s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:51 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" released by "delete_snapshot" :: held 3.136s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:51 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c44c16-d5ab-4435-8f6b-09b078f4ff0e]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:52 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Created reservations ['62d6bea1-9435-4637-a330-4dc3d8192476', '31f73f15-d5a4-4eed-94d8-99dd48f4dc2f', '26904264-a6d9-466f-b95f-3a043bb50515', '25a05bbe-b457-4617-8542-29464538e914'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:35:52 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Delete snapshot completed successfully.
Sep 16 11:35:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb505400-bb58-4a8b-88bd-2f6be3933f8d tempest-SnapshotsActionsTest-377934396 None] Lock "cinder-6b742374-c9cf-4118-a50e-4e73981f7559-delete_snapshot" released by "delete_snapshot" :: held 3.941s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61" returned: 0 in 0.699s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-3a5c9086-162d-4ff7-9ff8-3840e8391c61" returned: 0 in 0.133s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:52 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-3a5c9086-162d-4ff7-9ff8-3840e8391c61" released by "delete_volume" :: held 1.070s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:52 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Created reservations ['e7ba431a-3e7f-4a53-b67d-93d1b2731671', '426e5a20-dbcd-436f-a68b-7e0e094bc4a2', '6bbf8853-0b06-48fe-b0d5-089a3cd4c28b', 'e17a3006-9b1a-4455-bf94-471e37d55647'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:35:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:35:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:35:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.189s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:53 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:35:53 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Deleted volume successfully.
Sep 16 11:35:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "cinder-b1ee079d-d764-4693-b708-b12bb954c602-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "cinder-c0861857-9c6a-4444-b45b-804bf490d631-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-6a54a496-d456-41f5-ae2a-5608a7a97b63 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-3a5c9086-162d-4ff7-9ff8-3840e8391c61-delete_volume" released by "delete_volume" :: held 3.184s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Lock "cinder-b1ee079d-d764-4693-b708-b12bb954c602-delete_snapshot" acquired by "delete_snapshot" :: waited 0.175s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:54 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-c0861857-9c6a-4444-b45b-804bf490d631-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" acquired by "delete_snapshot" :: waited 0.050s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "cinder-quobyte-b1ee079d-d764-4693-b708-b12bb954c602" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:54 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "cinder-quobyte-c0861857-9c6a-4444-b45b-804bf490d631" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Lock "cinder-quobyte-b1ee079d-d764-4693-b708-b12bb954c602" acquired by "_delete_snapshot" :: waited 0.077s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Deleting offline snapshot b1ee079d-d764-4693-b708-b12bb954c602 of volume 7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] snapshot_file for this snap is: volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c9e60-b71f-465f-a7bc-235b30ca460c]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-c0861857-9c6a-4444-b45b-804bf490d631" acquired by "delete_volume" :: waited 0.254s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[3937b800-7405-40fc-b952-ddc981d54131]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:54 devstack quobyte-client[83411]: System call of process 97599 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:35:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.671s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7900bbd3-ea64-453a-a939-01b9e7612a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:35:55 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c77c2b8-82f2-4731-bc42-ac5fcbada3b0]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631" returned: 0 in 0.667s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c0861857-9c6a-4444-b45b-804bf490d631" returned: 0 in 0.172s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:55 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-quobyte-c0861857-9c6a-4444-b45b-804bf490d631" released by "delete_volume" :: held 1.103s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b" returned: 0 in 0.722s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.393s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:56 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Created reservations ['17c0afd8-4109-450e-b2dc-8cdd27faf2e9', '68fafd0c-4c1f-4082-8cf0-53599a6533c3', '55537c3e-bff3-4881-965d-0242560a6c40', '46c853bd-3740-485a-ae58-500e5d3656c3'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:35:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b.b1ee079d-d764-4693-b708-b12bb954c602" returned: 0 in 0.497s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Lock "cinder-quobyte-b1ee079d-d764-4693-b708-b12bb954c602" released by "_delete_snapshot" :: held 2.730s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:35:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:35:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:35:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:35:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:35:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:35:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" released by "delete_snapshot" :: held 3.052s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 1.259s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:35:58 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:35:58 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Deleted volume successfully.
Sep 16 11:35:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-603b5c50-0c77-4405-b8ed-7d9c37180cf6 tempest-SnapshotDependencyTests-248013483 None] Lock "cinder-c0861857-9c6a-4444-b45b-804bf490d631-delete_volume" released by "delete_volume" :: held 4.525s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:58 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Created reservations ['3e3883a1-091f-4435-85d8-3f6fc649c83f', '43f15e18-d5c8-4246-865f-129a0981719b', '18f908ef-f15d-4126-8bf8-6e753fd38cfd', '2d3e8322-0261-4741-8c83-bb43a3693fc9'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:35:59 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Delete snapshot completed successfully.
Sep 16 11:35:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e7ed72e5-66c4-490f-b80f-670a43704540 tempest-SnapshotsActionsTest-663976274 None] Lock "cinder-b1ee079d-d764-4693-b708-b12bb954c602-delete_snapshot" released by "delete_snapshot" :: held 5.018s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:35:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "cinder-7900bbd3-ea64-453a-a939-01b9e7612a4b-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Lock "cinder-7900bbd3-ea64-453a-a939-01b9e7612a4b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:59 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:35:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:35:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" acquired by "delete_volume" :: waited 0.024s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:35:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[463b0807-f5ce-4984-8cae-b7e6c192dd5f]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:35:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b" returned: 0 in 0.510s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7900bbd3-ea64-453a-a939-01b9e7612a4b" returned: 0 in 0.228s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:00 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Lock "cinder-quobyte-7900bbd3-ea64-453a-a939-01b9e7612a4b" released by "delete_volume" :: held 0.999s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:01 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Created reservations ['85d0cf76-95ff-46b7-9272-8e8e6a1d095d', '179d1091-de2e-4d28-a801-0b0a6c2745ff', '46fc4614-cf77-41f5-a7d6-9b03c3271835', '62c1f85f-d882-4f13-90a0-a98257c07249'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:36:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.275s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:02 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:36:02 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Deleted volume successfully.
Sep 16 11:36:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5a994a47-fc2a-4db4-bd50-c47b8eb16450 tempest-SnapshotsActionsTest-663976274 None] Lock "cinder-7900bbd3-ea64-453a-a939-01b9e7612a4b-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:11 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=38,cinder:SELECT=30,cinder:DELETE=2,cinder:INSERT=9 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:36:12 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Flow 'volume_create_manager' (7bf9d537-eb3a-4288-b7e2-3a8fe179f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d653d8-440c-488f-9b24-a9e952af9ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d653d8-440c-488f-9b24-a9e952af9ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1771295432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d700a6-f80b-4b21-af7b-2879a8dd5f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8d0006121294daf97990c4a5febcf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:12Z,use_quota=True,user_id='65277481a86143caa8c24f26d35adb2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b5a8ad-e61c-4de9-b920-25862c6dc11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b5a8ad-e61c-4de9-b920-25862c6dc11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912b8963-3350-4e78-8e45-a72c9095286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912b8963-3350-4e78-8e45-a72c9095286b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26d700a6-f80b-4b21-af7b-2879a8dd5f0a', 'volume_name': 'volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f17ad8-e0db-47a9-92eb-2c05499f96cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f17ad8-e0db-47a9-92eb-2c05499f96cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575d7835-7f89-4b77-80d2-8f3110aa5ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:12 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Volume 26d700a6-f80b-4b21-af7b-2879a8dd5f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a', 'volume_size': 1}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1771295432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26d700a6-f80b-4b21-af7b-2879a8dd5f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8d0006121294daf97990c4a5febcf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:12Z,use_quota=True,user_id='65277481a86143caa8c24f26d35adb2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Creating volume 26d700a6-f80b-4b21-af7b-2879a8dd5f0a {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:36:12 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:12 devstack quobyte-client[83411]: System call of process 97680 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:36:12 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=120, name=volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a 1073741824" returned: 0 in 0.437s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a" returned: 0 in 0.209s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] <== create_volume: return (748ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:36:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575d7835-7f89-4b77-80d2-8f3110aa5ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70147b62-610a-48aa-a1a9-6acba9b1f66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:13 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Volume volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a (26d700a6-f80b-4b21-af7b-2879a8dd5f0a): created successfully
Sep 16 11:36:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70147b62-610a-48aa-a1a9-6acba9b1f66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:13 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Flow 'volume_create_manager' (7bf9d537-eb3a-4288-b7e2-3a8fe179f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:13 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-43ec9be0-481a-4f2a-8d8c-cbcb6fb9c8b8 tempest-VolumeQuotasAdminTestJSON-849206905 None] Created volume successfully.
Sep 16 11:36:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Acquiring lock "cinder-26d700a6-f80b-4b21-af7b-2879a8dd5f0a-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "cinder-26d700a6-f80b-4b21-af7b-2879a8dd5f0a-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Acquiring lock "cinder-quobyte-26d700a6-f80b-4b21-af7b-2879a8dd5f0a" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "cinder-quobyte-26d700a6-f80b-4b21-af7b-2879a8dd5f0a" acquired by "delete_volume" :: waited 0.011s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:14 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacb61d4-98a4-4e3d-a9ef-dab6fde75e7d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:36:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a" returned: 0 in 0.465s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-26d700a6-f80b-4b21-af7b-2879a8dd5f0a" returned: 0 in 0.150s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "cinder-quobyte-26d700a6-f80b-4b21-af7b-2879a8dd5f0a" released by "delete_volume" :: held 0.782s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Created reservations ['a4c37d56-18ff-4c6d-a2fe-87e4d3491d38', '03079a7a-bcf6-4ea3-9a1f-37a465076320', 'd29a1856-0fcf-48db-b12f-17e552d3bc23', 'a62a2b63-64d3-4252-9d29-846382b4da5d'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.112s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:15 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:36:16 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Deleted volume successfully.
Sep 16 11:36:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b8092de4-bfb7-4ef6-9a3d-dd2bcd5c686d tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "cinder-26d700a6-f80b-4b21-af7b-2879a8dd5f0a-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:17 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Flow 'volume_create_manager' (1b9d24ae-1eb5-4f92-a2f2-6594f83a13ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570d9c4d-4f38-41ab-aa7a-fddc5239c8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570d9c4d-4f38-41ab-aa7a-fddc5239c8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-289283926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f441baf6-61e6-4293-aad3-58fb29ba85ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8d0006121294daf97990c4a5febcf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:17Z,use_quota=True,user_id='65277481a86143caa8c24f26d35adb2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d3729a-f7ef-478b-9530-a9d2f1c707bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d3729a-f7ef-478b-9530-a9d2f1c707bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5bcc27-e01a-4963-8d65-5d45e7dff10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5bcc27-e01a-4963-8d65-5d45e7dff10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f441baf6-61e6-4293-aad3-58fb29ba85ef', 'volume_name': 'volume-f441baf6-61e6-4293-aad3-58fb29ba85ef', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cab062-3ff7-4764-98af-2775950ecec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cab062-3ff7-4764-98af-2775950ecec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7b7e42-84f9-4dc6-a35e-137d574096a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:17 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Volume f441baf6-61e6-4293-aad3-58fb29ba85ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f441baf6-61e6-4293-aad3-58fb29ba85ef', 'volume_size': 1}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-289283926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f441baf6-61e6-4293-aad3-58fb29ba85ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8d0006121294daf97990c4a5febcf44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:17Z,use_quota=True,user_id='65277481a86143caa8c24f26d35adb2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Creating volume f441baf6-61e6-4293-aad3-58fb29ba85ef {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:36:17 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:36:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f441baf6-61e6-4293-aad3-58fb29ba85ef 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:17 devstack quobyte-client[83411]: System call of process 97690 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:36:17 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=121, name=volume-f441baf6-61e6-4293-aad3-58fb29ba85ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:36:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f441baf6-61e6-4293-aad3-58fb29ba85ef 1073741824" returned: 0 in 0.488s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f441baf6-61e6-4293-aad3-58fb29ba85ef {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f441baf6-61e6-4293-aad3-58fb29ba85ef" returned: 0 in 0.111s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] <== create_volume: return (682ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:36:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7b7e42-84f9-4dc6-a35e-137d574096a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f441baf6-61e6-4293-aad3-58fb29ba85ef', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b97656-ea35-470e-9a07-a3c25bfc7232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:18 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Volume volume-f441baf6-61e6-4293-aad3-58fb29ba85ef (f441baf6-61e6-4293-aad3-58fb29ba85ef): created successfully
Sep 16 11:36:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b97656-ea35-470e-9a07-a3c25bfc7232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Flow 'volume_create_manager' (1b9d24ae-1eb5-4f92-a2f2-6594f83a13ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:18 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-151b7c79-2c35-42d4-ad14-53e9b5cb8a80 tempest-VolumeQuotasAdminTestJSON-849206905 None] Created volume successfully.
Sep 16 11:36:20 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-b17e098a-bd32-4479-ad28-2c9f917d7a7f tempest-VolumeQuotasAdminTestJSON-681609181 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-b17e098a-bd32-4479-ad28-2c9f917d7a7f tempest-VolumeQuotasAdminTestJSON-681609181 None] Transfer volume completed successfully.
Sep 16 11:36:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Acquiring lock "cinder-f441baf6-61e6-4293-aad3-58fb29ba85ef-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Lock "cinder-f441baf6-61e6-4293-aad3-58fb29ba85ef-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:21 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Acquiring lock "cinder-quobyte-f441baf6-61e6-4293-aad3-58fb29ba85ef" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Lock "cinder-quobyte-f441baf6-61e6-4293-aad3-58fb29ba85ef" acquired by "delete_volume" :: waited 0.015s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:21 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83cb298-d866-49b9-8e34-0ea4aa68d632]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:36:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f441baf6-61e6-4293-aad3-58fb29ba85ef {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f441baf6-61e6-4293-aad3-58fb29ba85ef" returned: 0 in 0.405s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f441baf6-61e6-4293-aad3-58fb29ba85ef {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f441baf6-61e6-4293-aad3-58fb29ba85ef" returned: 0 in 0.109s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Lock "cinder-quobyte-f441baf6-61e6-4293-aad3-58fb29ba85ef" released by "delete_volume" :: held 0.675s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:22 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Created reservations ['b43ff72f-732a-4cf2-917e-b26def342726', 'cff013a7-9e40-4136-bbb1-1e41b361eb32', '26960f75-3f50-4ac5-8e31-a3b97ae746d1', '8844299b-1bf4-4d29-a4da-656d80742f9e'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:36:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.155s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:22 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:36:22 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Deleted volume successfully.
Sep 16 11:36:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87c33bd8-bacd-4ee1-bba3-8d7854979c67 tempest-VolumeQuotasAdminTestJSON-1401557085 None] Lock "cinder-f441baf6-61e6-4293-aad3-58fb29ba85ef-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-84aa2923-4804-4848-9281-ad11bca43800 req-4d040344-994d-4601-bde5-3387e4d3b836 tempest-TestMinimumBasicScenario-1802021186 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-84aa2923-4804-4848-9281-ad11bca43800 req-4d040344-994d-4601-bde5-3387e4d3b836 tempest-TestMinimumBasicScenario-1802021186 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-84aa2923-4804-4848-9281-ad11bca43800 req-4d040344-994d-4601-bde5-3387e4d3b836 tempest-TestMinimumBasicScenario-1802021186 None] Terminate volume connection completed successfully.
Sep 16 11:36:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-84aa2923-4804-4848-9281-ad11bca43800 req-4d040344-994d-4601-bde5-3387e4d3b836 tempest-TestMinimumBasicScenario-1802021186 None] Deleting attachment e974de35-8626-449d-9394-3093425d5f23. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.218s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Acquiring lock "cinder-f6e652eb-04a1-487f-bbf1-7736a4885f24-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:26 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Lock "cinder-f6e652eb-04a1-487f-bbf1-7736a4885f24-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Acquiring lock "cinder-quobyte-f6e652eb-04a1-487f-bbf1-7736a4885f24" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Lock "cinder-quobyte-f6e652eb-04a1-487f-bbf1-7736a4885f24" acquired by "delete_volume" :: waited 0.024s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:27 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5300468-091d-4c01-a089-d8875508bd95]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:36:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f6e652eb-04a1-487f-bbf1-7736a4885f24 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f6e652eb-04a1-487f-bbf1-7736a4885f24" returned: 0 in 0.512s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f6e652eb-04a1-487f-bbf1-7736a4885f24 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-f6e652eb-04a1-487f-bbf1-7736a4885f24" returned: 0 in 0.117s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Lock "cinder-quobyte-f6e652eb-04a1-487f-bbf1-7736a4885f24" released by "delete_volume" :: held 0.842s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:28 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Created reservations ['f73fbd4b-9c56-4e43-b46f-146caafc67fa', '63b998aa-8123-4611-816c-39627a34323a', '2e40f49d-07e2-4b33-af32-dd9cb46b1584', '40b05fd4-1680-425b-9961-2d6a680f8bf2'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:36:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.098s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:28 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:36:29 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Deleted volume successfully.
Sep 16 11:36:29 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b47dccb5-a994-43f1-a695-5136302b6afa tempest-TestMinimumBasicScenario-1802021186 None] Lock "cinder-f6e652eb-04a1-487f-bbf1-7736a4885f24-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=74,cinder:DELETE=7,cinder:SELECT=45,cinder:INSERT=21 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:36:39 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=30,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:36:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Flow 'volume_create_manager' (b3f66989-e3f6-40ad-bd3c-2545ea433cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c8686c-09b6-4640-97a0-59157bb10971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c8686c-09b6-4640-97a0-59157bb10971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-289661546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8150bd3d-f390-4953-a8f5-3240f502a45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f65c4fe40bb41f09e0a4b4d9816f564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:42Z,use_quota=True,user_id='54cfb3d9719942c797ce04315a4c6cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f4faaa-3f4c-428a-b178-b47f45992336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04f4faaa-3f4c-428a-b178-b47f45992336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c95230-8135-4071-bcf1-3747b85a81e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c95230-8135-4071-bcf1-3747b85a81e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8150bd3d-f390-4953-a8f5-3240f502a45a', 'volume_name': 'volume-8150bd3d-f390-4953-a8f5-3240f502a45a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510267ad-d13e-499d-878e-ade66e5ae005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (510267ad-d13e-499d-878e-ade66e5ae005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f278d2c1-08e6-4b5d-b43d-af80fc30fd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:42 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Volume 8150bd3d-f390-4953-a8f5-3240f502a45a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8150bd3d-f390-4953-a8f5-3240f502a45a', 'volume_size': 1}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-289661546',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8150bd3d-f390-4953-a8f5-3240f502a45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f65c4fe40bb41f09e0a4b4d9816f564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:42Z,use_quota=True,user_id='54cfb3d9719942c797ce04315a4c6cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Creating volume 8150bd3d-f390-4953-a8f5-3240f502a45a {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:36:42 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:36:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-8150bd3d-f390-4953-a8f5-3240f502a45a 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:42 devstack quobyte-client[83411]: System call of process 97764 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:36:42 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=122, name=volume-8150bd3d-f390-4953-a8f5-3240f502a45a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:36:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-8150bd3d-f390-4953-a8f5-3240f502a45a 1073741824" returned: 0 in 0.427s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-8150bd3d-f390-4953-a8f5-3240f502a45a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-8150bd3d-f390-4953-a8f5-3240f502a45a" returned: 0 in 0.211s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:43 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] <== create_volume: return (715ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:36:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f278d2c1-08e6-4b5d-b43d-af80fc30fd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8150bd3d-f390-4953-a8f5-3240f502a45a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baee31b1-84c6-4d56-aa62-d31e1d0eae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:43 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Volume volume-8150bd3d-f390-4953-a8f5-3240f502a45a (8150bd3d-f390-4953-a8f5-3240f502a45a): created successfully
Sep 16 11:36:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baee31b1-84c6-4d56-aa62-d31e1d0eae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Flow 'volume_create_manager' (b3f66989-e3f6-40ad-bd3c-2545ea433cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:43 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5a23bba9-2d6b-4b75-b034-e007002267e8 tempest-VolumesListAdminTestJSON-287724694 None] Created volume successfully.
Sep 16 11:36:45 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Flow 'volume_create_manager' (89be494a-1d1f-4ef6-9edf-2fb3c2741f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4be08b-dc9f-4415-9a2a-8a14aaf6ca1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4be08b-dc9f-4415-9a2a-8a14aaf6ca1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1029549986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c1ed97-63ed-4278-aab7-cd64651cdb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f65c4fe40bb41f09e0a4b4d9816f564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:45Z,use_quota=True,user_id='54cfb3d9719942c797ce04315a4c6cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bfaaa2-e163-4b6a-8ead-23612628c43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bfaaa2-e163-4b6a-8ead-23612628c43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe12734-ab6b-40c8-bc13-0cf23c9e9842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe12734-ab6b-40c8-bc13-0cf23c9e9842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c1ed97-63ed-4278-aab7-cd64651cdb6c', 'volume_name': 'volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03218d26-7bf9-449d-ab8b-29a9bb444dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03218d26-7bf9-449d-ab8b-29a9bb444dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1734ba74-947f-40b9-9fd9-62aa64f31566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:45 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Volume a3c1ed97-63ed-4278-aab7-cd64651cdb6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c', 'volume_size': 1}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1029549986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c1ed97-63ed-4278-aab7-cd64651cdb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f65c4fe40bb41f09e0a4b4d9816f564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:45Z,use_quota=True,user_id='54cfb3d9719942c797ce04315a4c6cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Creating volume a3c1ed97-63ed-4278-aab7-cd64651cdb6c {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:36:45 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:45 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=123, name=volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c 1073741824" returned: 0 in 0.400s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c" returned: 0 in 0.118s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] <== create_volume: return (587ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:36:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.601s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1734ba74-947f-40b9-9fd9-62aa64f31566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe194cf-ffbe-4ab3-ab62-8143f140347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:46 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Volume volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c (a3c1ed97-63ed-4278-aab7-cd64651cdb6c): created successfully
Sep 16 11:36:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe194cf-ffbe-4ab3-ab62-8143f140347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Flow 'volume_create_manager' (89be494a-1d1f-4ef6-9edf-2fb3c2741f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-23161d33-2f4b-4024-ad20-55df1d1b04e5 tempest-VolumesListAdminTestJSON-287724694 None] Created volume successfully.
Sep 16 11:36:48 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Flow 'volume_create_manager' (ced9122f-084d-44a4-a4db-e446ae18bb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0af10c-f063-4605-8d1b-747e5f4eb286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0af10c-f063-4605-8d1b-747e5f4eb286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-453288441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9217982a-974e-441d-9a0e-f32346dc0168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f65c4fe40bb41f09e0a4b4d9816f564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:48Z,use_quota=True,user_id='54cfb3d9719942c797ce04315a4c6cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4a337b-4306-49c7-a76e-ef165715b4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4a337b-4306-49c7-a76e-ef165715b4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223e8838-bb75-45cf-856f-bf65fbf6f8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223e8838-bb75-45cf-856f-bf65fbf6f8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9217982a-974e-441d-9a0e-f32346dc0168', 'volume_name': 'volume-9217982a-974e-441d-9a0e-f32346dc0168', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f71b02-7442-4521-8b97-e0291b8fb5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42f71b02-7442-4521-8b97-e0291b8fb5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e93b169-8e9c-40d7-a03f-2cb1e5a60060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:48 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Volume 9217982a-974e-441d-9a0e-f32346dc0168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9217982a-974e-441d-9a0e-f32346dc0168', 'volume_size': 1}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-453288441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9217982a-974e-441d-9a0e-f32346dc0168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f65c4fe40bb41f09e0a4b4d9816f564',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:48Z,use_quota=True,user_id='54cfb3d9719942c797ce04315a4c6cf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Creating volume 9217982a-974e-441d-9a0e-f32346dc0168 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:36:48 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9217982a-974e-441d-9a0e-f32346dc0168 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:48 devstack quobyte-client[83411]: System call of process 97777 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:36:48 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=124, name=volume-9217982a-974e-441d-9a0e-f32346dc0168, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9217982a-974e-441d-9a0e-f32346dc0168 1073741824" returned: 0 in 0.414s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9217982a-974e-441d-9a0e-f32346dc0168 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9217982a-974e-441d-9a0e-f32346dc0168" returned: 0 in 0.134s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] <== create_volume: return (672ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:36:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e93b169-8e9c-40d7-a03f-2cb1e5a60060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9217982a-974e-441d-9a0e-f32346dc0168', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d001e85-f8cc-4f7c-8ffd-6b82295e4f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:49 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Volume volume-9217982a-974e-441d-9a0e-f32346dc0168 (9217982a-974e-441d-9a0e-f32346dc0168): created successfully
Sep 16 11:36:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d001e85-f8cc-4f7c-8ffd-6b82295e4f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Flow 'volume_create_manager' (ced9122f-084d-44a4-a4db-e446ae18bb4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:49 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d6ea94ac-0934-4165-b900-2261a74bf004 tempest-VolumesListAdminTestJSON-287724694 None] Created volume successfully.
Sep 16 11:36:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Flow 'volume_create_manager' (266362e7-2ee4-4a0c-8e67-b161dfa0c770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891fe7a4-e2b2-41cf-9446-5ee3c15be75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891fe7a4-e2b2-41cf-9446-5ee3c15be75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917f3615-2cba-42fa-88f0-4c81e6b64052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3adc26e114a475eacedfec3973324f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:51Z,use_quota=True,user_id='54be952ea54c41c6a123c96c6d51258e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a462883-70bb-4644-8fd3-2074666affca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a462883-70bb-4644-8fd3-2074666affca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447f93dc-58ae-40a6-b8d0-350fce762174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447f93dc-58ae-40a6-b8d0-350fce762174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917f3615-2cba-42fa-88f0-4c81e6b64052', 'volume_name': 'volume-917f3615-2cba-42fa-88f0-4c81e6b64052', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e8d9b0-0ec4-4a63-ba2a-b4a3a6806102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e8d9b0-0ec4-4a63-ba2a-b4a3a6806102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4916d1-422c-4311-a59f-86d8dc7dfef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:51 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Volume 917f3615-2cba-42fa-88f0-4c81e6b64052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917f3615-2cba-42fa-88f0-4c81e6b64052', 'volume_size': 1}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917f3615-2cba-42fa-88f0-4c81e6b64052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3adc26e114a475eacedfec3973324f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:36:51Z,use_quota=True,user_id='54be952ea54c41c6a123c96c6d51258e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Creating volume 917f3615-2cba-42fa-88f0-4c81e6b64052 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:36:51 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-917f3615-2cba-42fa-88f0-4c81e6b64052 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:51 devstack quobyte-client[83411]: System call of process 97783 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:36:51 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=125, name=volume-917f3615-2cba-42fa-88f0-4c81e6b64052, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-917f3615-2cba-42fa-88f0-4c81e6b64052 1073741824" returned: 0 in 0.332s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-917f3615-2cba-42fa-88f0-4c81e6b64052 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-917f3615-2cba-42fa-88f0-4c81e6b64052" returned: 0 in 0.243s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] <== create_volume: return (678ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:36:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4916d1-422c-4311-a59f-86d8dc7dfef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917f3615-2cba-42fa-88f0-4c81e6b64052', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a33d46-4d5f-4a65-bd15-7d090ebcaad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:36:52 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Volume volume-917f3615-2cba-42fa-88f0-4c81e6b64052 (917f3615-2cba-42fa-88f0-4c81e6b64052): created successfully
Sep 16 11:36:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a33d46-4d5f-4a65-bd15-7d090ebcaad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:36:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Flow 'volume_create_manager' (266362e7-2ee4-4a0c-8e67-b161dfa0c770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:36:52 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-239611ff-05ea-4dee-a104-5e653ed49cbb tempest-VolumesListAdminTestJSON-1006746332 None] Created volume successfully.
Sep 16 11:36:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Acquiring lock "cinder-917f3615-2cba-42fa-88f0-4c81e6b64052-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Lock "cinder-917f3615-2cba-42fa-88f0-4c81e6b64052-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "cinder-9217982a-974e-441d-9a0e-f32346dc0168-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:53 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Acquiring lock "cinder-quobyte-917f3615-2cba-42fa-88f0-4c81e6b64052" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-9217982a-974e-441d-9a0e-f32346dc0168-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Lock "cinder-quobyte-917f3615-2cba-42fa-88f0-4c81e6b64052" acquired by "delete_volume" :: waited 0.040s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:53 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe50286-4cf4-4b81-b77e-21adef46d65f]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:36:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-917f3615-2cba-42fa-88f0-4c81e6b64052 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:54 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "cinder-quobyte-9217982a-974e-441d-9a0e-f32346dc0168" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-quobyte-9217982a-974e-441d-9a0e-f32346dc0168" acquired by "delete_volume" :: waited 0.084s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:54 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d67fa47-5b59-4384-ba34-bd2c735a675a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:36:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9217982a-974e-441d-9a0e-f32346dc0168 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-917f3615-2cba-42fa-88f0-4c81e6b64052" returned: 0 in 0.749s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-917f3615-2cba-42fa-88f0-4c81e6b64052 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-917f3615-2cba-42fa-88f0-4c81e6b64052" returned: 0 in 0.272s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Lock "cinder-quobyte-917f3615-2cba-42fa-88f0-4c81e6b64052" released by "delete_volume" :: held 1.219s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9217982a-974e-441d-9a0e-f32346dc0168" returned: 0 in 0.825s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9217982a-974e-441d-9a0e-f32346dc0168 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-9217982a-974e-441d-9a0e-f32346dc0168" returned: 0 in 0.339s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-quobyte-9217982a-974e-441d-9a0e-f32346dc0168" released by "delete_volume" :: held 1.323s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Created reservations ['320164ac-b3de-4bc2-bad6-e9241de7f000', 'aa146842-4def-49ba-a4e4-3c214223a641', '774ba561-f981-46e9-baad-6d295c6305a0', '18654901-83cb-419f-a2d5-d4b2cbd0489a'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Created reservations ['9f8ec6c5-df6e-4f93-9673-20388eb801c2', '6ed49961-5193-4ebc-a286-31653711c126', '459d3dd9-c9ee-4ca3-aea0-ccdb3b347929', '59395e87-c557-4741-930b-88e6059b146d'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.295s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "cinder-a3c1ed97-63ed-4278-aab7-cd64651cdb6c-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:56 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Deleted volume successfully.
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.444s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:36:56 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Deleted volume successfully.
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-a3c1ed97-63ed-4278-aab7-cd64651cdb6c-delete_volume" acquired by "delete_volume" :: waited 0.337s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-fce132c8-a55d-4868-8f93-0758efe55428 tempest-VolumesListAdminTestJSON-1006746332 None] Lock "cinder-917f3615-2cba-42fa-88f0-4c81e6b64052-delete_volume" released by "delete_volume" :: held 3.388s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-9fce613b-c269-4456-847e-c1a2eab35074 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-9217982a-974e-441d-9a0e-f32346dc0168-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:56 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "cinder-quobyte-a3c1ed97-63ed-4278-aab7-cd64651cdb6c" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-quobyte-a3c1ed97-63ed-4278-aab7-cd64651cdb6c" acquired by "delete_volume" :: waited 0.012s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fdfb04-9b49-4214-8b1b-1a8c08609133]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:36:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c" returned: 0 in 0.456s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a3c1ed97-63ed-4278-aab7-cd64651cdb6c" returned: 0 in 0.107s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:57 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-quobyte-a3c1ed97-63ed-4278-aab7-cd64651cdb6c" released by "delete_volume" :: held 0.772s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:58 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Created reservations ['9ec60663-1c49-4eb8-8512-a67d9d85475c', '23e6dc68-a24f-48b4-8be6-97b85c11b520', 'b3f5e19e-9fcf-4724-b29a-268de4589126', 'c63d37f2-dbf9-4cc0-acec-5f5c71dca0f1'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:36:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:36:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:36:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:36:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:36:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:36:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.122s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:36:58 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:36:58 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Deleted volume successfully.
Sep 16 11:36:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "cinder-8150bd3d-f390-4953-a8f5-3240f502a45a-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-158419ea-621a-4291-80dc-bd6a8c090428 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-a3c1ed97-63ed-4278-aab7-cd64651cdb6c-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:36:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-8150bd3d-f390-4953-a8f5-3240f502a45a-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:59 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:36:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "cinder-quobyte-8150bd3d-f390-4953-a8f5-3240f502a45a" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:36:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-quobyte-8150bd3d-f390-4953-a8f5-3240f502a45a" acquired by "delete_volume" :: waited 0.014s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:36:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[452bec41-96cf-46a9-ba69-fbff7da34ef3]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:36:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-8150bd3d-f390-4953-a8f5-3240f502a45a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:36:59 devstack quobyte-client[83411]: System call of process 97803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:37:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-8150bd3d-f390-4953-a8f5-3240f502a45a" returned: 0 in 0.659s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-8150bd3d-f390-4953-a8f5-3240f502a45a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-8150bd3d-f390-4953-a8f5-3240f502a45a" returned: 0 in 0.268s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:00 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-quobyte-8150bd3d-f390-4953-a8f5-3240f502a45a" released by "delete_volume" :: held 1.185s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:37:00 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Created reservations ['e20e8fc5-1e7d-4f51-b508-b8c7212aed43', '7a5c56cc-283e-40d4-a9f2-6310d2020087', 'a5e13ff2-abd7-4624-bd9b-7ed226135ddc', 'becdca8f-5d0b-44bc-ad38-300e99c2d38a'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:37:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:37:01 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:37:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.140s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:01 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:37:01 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Deleted volume successfully.
Sep 16 11:37:01 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3a278f3c-5025-47a0-932d-563cdccaa120 tempest-VolumesListAdminTestJSON-287724694 None] Lock "cinder-8150bd3d-f390-4953-a8f5-3240f502a45a-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=42,cinder:SELECT=25,cinder:DELETE=4,cinder:INSERT=4 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:37:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Flow 'volume_create_manager' (568f0a84-fef1-4f9a-b538-a072a0093ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d8664f-a560-48d7-9ad8-6bc312bce676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d8664f-a560-48d7-9ad8-6bc312bce676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1077122900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62000c5-ad8e-4dfe-8cde-107c830a623e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fc45e8252f409cb7a6c8ffaf5a56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:37:11Z,use_quota=True,user_id='39b4fd4799f24753b429208797f0a997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907b5536-e2cb-4fc2-9ae7-b53d5efbc2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907b5536-e2cb-4fc2-9ae7-b53d5efbc2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3020da60-3ec8-4bcd-9e36-0eaacceb5381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3020da60-3ec8-4bcd-9e36-0eaacceb5381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e62000c5-ad8e-4dfe-8cde-107c830a623e', 'volume_name': 'volume-e62000c5-ad8e-4dfe-8cde-107c830a623e', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8931fccd0>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95531a59-9dbb-4ed0-a5b3-e689dad78c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95531a59-9dbb-4ed0-a5b3-e689dad78c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdcf102b-91c3-4eb4-a88b-a12976e7c829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:11 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Volume e62000c5-ad8e-4dfe-8cde-107c830a623e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e62000c5-ad8e-4dfe-8cde-107c830a623e', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8931fccd0>}
Sep 16 11:37:11 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Cloning e62000c5-ad8e-4dfe-8cde-107c830a623e from image ae172bdc-0a7f-403f-a999-85b28d841ddd  at location (None, None). {{(pid=83386) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 16 11:37:12 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 16 11:37:12 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 11:37:12 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3452d7-5162-445d-a20c-534cafc7e2c8]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:37:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:12 devstack sudo[97850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD
Sep 16 11:37:12 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:37:14 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root
Sep 16 11:37:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD" returned: 0 in 2.283s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:14 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Temporary image ae172bdc-0a7f-403f-a999-85b28d841ddd is fetched for user 39b4fd4799f24753b429208797f0a997. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 16 11:37:15 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7648536-2a45-4aa5-bfba-3338d30db102]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:37:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:15 devstack sudo[97855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD
Sep 16 11:37:15 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:37:17 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD" returned: 0 in 2.637s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1077122900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62000c5-ad8e-4dfe-8cde-107c830a623e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2fc45e8252f409cb7a6c8ffaf5a56b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:37:11Z,use_quota=True,user_id='39b4fd4799f24753b429208797f0a997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Creating volume e62000c5-ad8e-4dfe-8cde-107c830a623e {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:37:17 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:37:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:18 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=126, name=volume-e62000c5-ad8e-4dfe-8cde-107c830a623e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:37:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e 1073741824" returned: 0 in 0.487s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e" returned: 0 in 0.111s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] <== create_volume: return (723ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:37:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:18 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Attempting download of ae172bdc-0a7f-403f-a999-85b28d841ddd ((None, None)) to volume e62000c5-ad8e-4dfe-8cde-107c830a623e. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 16 11:37:19 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3de7135-6178-4a4a-8639-ad11f26bd922]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:37:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_ap1icjtb {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_ap1icjtb" returned: 0 in 0.440s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_ap1icjtb {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_ap1icjtb" returned: 1 in 0.458s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_ap1icjtb' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:37:20 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b172d8-2c23-4571-ac5f-d128e0653548]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:37:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD" returned: 0 in 0.417s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:20 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] ae172bdc-0a7f-403f-a999-85b28d841ddd was qcow2, converting to raw {{(pid=83386) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 16 11:37:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:20 devstack quobyte-client[83411]: System call of process 97871 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:37:20 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=126, name=volume-e62000c5-ad8e-4dfe-8cde-107c830a623e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:37:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e" returned: 0 in 1.429s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:21 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_ijdbb828devstack@QuobyteHD, size 112.00 MB, duration 1.47 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:37:21 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Converted 112.00 MB image at 76.37 MB/s
Sep 16 11:37:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:22 devstack quobyte-client[83411]: System call of process 97878 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:37:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e 1G" returned: 0 in 0.178s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:22 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15bd7d8-19ec-4227-b418-24601ba41868]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:37:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e" returned: 0 in 0.464s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e" returned: 1 in 0.496s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Downloaded image ae172bdc-0a7f-403f-a999-85b28d841ddd ((None, None)) to volume e62000c5-ad8e-4dfe-8cde-107c830a623e successfully. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Temporary image ae172bdc-0a7f-403f-a999-85b28d841ddd for user 39b4fd4799f24753b429208797f0a997 is deleted. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Marking volume e62000c5-ad8e-4dfe-8cde-107c830a623e as bootable. {{(pid=83386) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Copying metadata from image ae172bdc-0a7f-403f-a999-85b28d841ddd to e62000c5-ad8e-4dfe-8cde-107c830a623e. {{(pid=83386) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Creating volume glance metadata for volume e62000c5-ad8e-4dfe-8cde-107c830a623e backed by image ae172bdc-0a7f-403f-a999-85b28d841ddd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83386) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdcf102b-91c3-4eb4-a88b-a12976e7c829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e62000c5-ad8e-4dfe-8cde-107c830a623e', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8931fccd0>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e6fa71-4d96-4897-bc44-b5ba942ed0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:23 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Volume volume-e62000c5-ad8e-4dfe-8cde-107c830a623e (e62000c5-ad8e-4dfe-8cde-107c830a623e): created successfully
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e6fa71-4d96-4897-bc44-b5ba942ed0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Flow 'volume_create_manager' (568f0a84-fef1-4f9a-b538-a072a0093ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:37:23 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-300562b1-4f5d-4c97-b4f3-b4239d69ebee tempest-VolumesImageMetadata-817479028 None] Created volume successfully.
Sep 16 11:37:24 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Acquiring lock "cinder-e62000c5-ad8e-4dfe-8cde-107c830a623e-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:37:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Lock "cinder-e62000c5-ad8e-4dfe-8cde-107c830a623e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:37:25 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:37:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Acquiring lock "cinder-quobyte-e62000c5-ad8e-4dfe-8cde-107c830a623e" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:37:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Lock "cinder-quobyte-e62000c5-ad8e-4dfe-8cde-107c830a623e" acquired by "delete_volume" :: waited 0.036s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:37:25 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8afd00-31a9-4132-b21d-a5a528f5d922]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:37:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e" returned: 0 in 0.515s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e" returned: 1 in 0.802s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.592s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e62000c5-ad8e-4dfe-8cde-107c830a623e" returned: 0 in 0.533s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Flow 'volume_create_manager' (6254bd8e-5bd7-4511-9eb8-d1a5773c4c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ebab24-6a77-4ac1-9fd9-5b1cde77eaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Flow 'volume_create_manager' (1db9e2be-c8c3-405d-a508-68c82ea5d9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d40a8d5-b62e-4369-8c91-072b3fd539fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Lock "cinder-quobyte-e62000c5-ad8e-4dfe-8cde-107c830a623e" released by "delete_volume" :: held 2.291s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d40a8d5-b62e-4369-8c91-072b3fd539fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-350969356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c3f301-de17-4ebc-a2ab-12a0b8cf2a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d01a5f9297400f8ad70d6563d5c86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:37:26Z,use_quota=True,user_id='2d8421a37333498fb74effdd2b383e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed968108-0696-4220-a597-67c353e7e344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed968108-0696-4220-a597-67c353e7e344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02614dd3-c5f8-48b7-86b1-2dd4c0801361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02614dd3-c5f8-48b7-86b1-2dd4c0801361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c3f301-de17-4ebc-a2ab-12a0b8cf2a08', 'volume_name': 'volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee1aaa4-4e2c-4c1b-bde6-3c3a898ad401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee1aaa4-4e2c-4c1b-bde6-3c3a898ad401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213b67e2-78e1-4a58-a478-a9be4db92598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:27 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume 21c3f301-de17-4ebc-a2ab-12a0b8cf2a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08', 'volume_size': 1}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-350969356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c3f301-de17-4ebc-a2ab-12a0b8cf2a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d01a5f9297400f8ad70d6563d5c86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:37:26Z,use_quota=True,user_id='2d8421a37333498fb74effdd2b383e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Creating volume 21c3f301-de17-4ebc-a2ab-12a0b8cf2a08 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:37:27 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:37:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:27 devstack quobyte-client[83411]: System call of process 97893 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:37:27 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=127, name=volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ebab24-6a77-4ac1-9fd9-5b1cde77eaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-976420357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7930743a-2579-4408-a867-7f5d53a72fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d01a5f9297400f8ad70d6563d5c86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:37:27Z,use_quota=True,user_id='2d8421a37333498fb74effdd2b383e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b951c75-dca6-4111-846c-33bc823b2e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b951c75-dca6-4111-846c-33bc823b2e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefbc47e-522b-4e1c-9207-e93cbd123b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fefbc47e-522b-4e1c-9207-e93cbd123b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7930743a-2579-4408-a867-7f5d53a72fea', 'volume_name': 'volume-7930743a-2579-4408-a867-7f5d53a72fea', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e586efa9-25f3-45c4-bd50-736186cf97c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e586efa9-25f3-45c4-bd50-736186cf97c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30faebdb-7a68-4f84-9c2f-21e09bf43eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:28 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume 7930743a-2579-4408-a867-7f5d53a72fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7930743a-2579-4408-a867-7f5d53a72fea', 'volume_size': 1}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08 1073741824" returned: 0 in 0.543s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08" returned: 0 in 0.372s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] <== create_volume: return (963ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-976420357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7930743a-2579-4408-a867-7f5d53a72fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d01a5f9297400f8ad70d6563d5c86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:37:27Z,use_quota=True,user_id='2d8421a37333498fb74effdd2b383e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Creating volume 7930743a-2579-4408-a867-7f5d53a72fea {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:37:28 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7930743a-2579-4408-a867-7f5d53a72fea 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:28 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=128, name=volume-7930743a-2579-4408-a867-7f5d53a72fea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:37:28 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Created reservations ['d0c95eb2-df8c-4c53-8ce5-b7d602d78413', '64015ebe-9d93-4a27-bbef-15ab24650372', 'd66d850b-aa52-432c-8589-c4d6eae54981', '9adcb698-3c9e-4444-aeb9-ffe303fc9555'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213b67e2-78e1-4a58-a478-a9be4db92598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7adcb14-efce-4450-b740-2d9857d6eedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7930743a-2579-4408-a867-7f5d53a72fea 1073741824" returned: 0 in 0.539s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7930743a-2579-4408-a867-7f5d53a72fea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:29 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08 (21c3f301-de17-4ebc-a2ab-12a0b8cf2a08): created successfully
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7adcb14-efce-4450-b740-2d9857d6eedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Flow 'volume_create_manager' (1db9e2be-c8c3-405d-a508-68c82ea5d9d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7930743a-2579-4408-a867-7f5d53a72fea" returned: 0 in 0.457s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] <== create_volume: return (1033ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:29 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8ec49ff0-429d-4cb0-b782-95d717b02d7e tempest-TestServerVolumeAttachmentScenario-1725998046 None] Created volume successfully.
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30faebdb-7a68-4f84-9c2f-21e09bf43eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7930743a-2579-4408-a867-7f5d53a72fea', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d687bcbf-9db8-43cf-81a9-fb8d0ac7a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:29 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume volume-7930743a-2579-4408-a867-7f5d53a72fea (7930743a-2579-4408-a867-7f5d53a72fea): created successfully
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d687bcbf-9db8-43cf-81a9-fb8d0ac7a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Flow 'volume_create_manager' (6254bd8e-5bd7-4511-9eb8-d1a5773c4c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:29 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-240f34b3-7cd5-4864-8e5e-4495798086a8 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Created volume successfully.
Sep 16 11:37:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.262s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:30 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:37:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Deleted volume successfully.
Sep 16 11:37:30 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d08f1815-1664-4783-b050-c2dd0c9bb3d7 tempest-VolumesImageMetadata-817479028 None] Lock "cinder-e62000c5-ad8e-4dfe-8cde-107c830a623e-delete_volume" released by "delete_volume" :: held 5.305s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:37:35 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Flow 'volume_create_manager' (e97bddb0-daa1-4c79-bd3d-db527eb9879d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5f7200-5c2b-4fdf-bcd3-fd5b8bb25309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5f7200-5c2b-4fdf-bcd3-fd5b8bb25309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-668165106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde12d15-b620-4849-b731-0a8bd7be70c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17faac2e68a14d4db64cda8b38fb654f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:37:35Z,use_quota=True,user_id='5430e5fd912343079dd5ad61caefbdd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934b7bc9-16ae-46e3-8c52-c7230f81a746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (934b7bc9-16ae-46e3-8c52-c7230f81a746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c8902d-34a6-494b-931a-edeb09a09aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c8902d-34a6-494b-931a-edeb09a09aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde12d15-b620-4849-b731-0a8bd7be70c8', 'volume_name': 'volume-dde12d15-b620-4849-b731-0a8bd7be70c8', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1242ea2-2bcf-4d58-8bca-d74fd6663b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1242ea2-2bcf-4d58-8bca-d74fd6663b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316a426b-196f-455e-a290-e6e00ef8e4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:35 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Volume dde12d15-b620-4849-b731-0a8bd7be70c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde12d15-b620-4849-b731-0a8bd7be70c8', 'volume_size': 1}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-668165106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde12d15-b620-4849-b731-0a8bd7be70c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17faac2e68a14d4db64cda8b38fb654f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:37:35Z,use_quota=True,user_id='5430e5fd912343079dd5ad61caefbdd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Creating volume dde12d15-b620-4849-b731-0a8bd7be70c8 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:37:35 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:35 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=129, name=volume-dde12d15-b620-4849-b731-0a8bd7be70c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8 1073741824" returned: 0 in 0.368s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8" returned: 0 in 0.140s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] <== create_volume: return (584ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:37:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.596s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316a426b-196f-455e-a290-e6e00ef8e4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde12d15-b620-4849-b731-0a8bd7be70c8', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809e1427-4355-4d74-afdc-f74e9eb2999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:37:36 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Volume volume-dde12d15-b620-4849-b731-0a8bd7be70c8 (dde12d15-b620-4849-b731-0a8bd7be70c8): created successfully
Sep 16 11:37:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809e1427-4355-4d74-afdc-f74e9eb2999e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:37:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Flow 'volume_create_manager' (e97bddb0-daa1-4c79-bd3d-db527eb9879d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:37:36 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-0586d5b2-364a-4784-bb6c-e896e2593e30 tempest-SnapshotMetadataTestJSON-829192873 None] Created volume successfully.
Sep 16 11:37:37 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:37:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Creating offline snapshot 7bb1c227-9af6-4bfd-9398-1723b5514a87 of volume dde12d15-b620-4849-b731-0a8bd7be70c8 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:37:37 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd580db-a009-4529-96f8-0c5c47420c85]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:37:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8" returned: 0 in 0.531s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:38 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=130, name=volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:37:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87 1G" returned: 0 in 0.285s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): qemu-img rebase -u -b volume-dde12d15-b620-4849-b731-0a8bd7be70c8 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "qemu-img rebase -u -b volume-dde12d15-b620-4849-b731-0a8bd7be70c8 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87" returned: 0 in 0.172s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:37:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87" returned: 0 in 0.170s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:37:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87" returned: 0 in 0.167s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.info" returned: 0 in 0.163s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:37:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.info" returned: 0 in 0.258s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:40 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=42,cinder:UPDATE=53,cinder:DELETE=7,cinder:INSERT=20 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:37:40 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-c91660ae-bdca-4b58-8936-f309e6e6c312 tempest-SnapshotMetadataTestJSON-829192873 None] Create snapshot completed successfully
Sep 16 11:37:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Acquiring lock "cinder-7bb1c227-9af6-4bfd-9398-1723b5514a87-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:37:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Lock "cinder-7bb1c227-9af6-4bfd-9398-1723b5514a87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:37:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:37:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Acquiring lock "cinder-quobyte-dde12d15-b620-4849-b731-0a8bd7be70c8" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:37:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Lock "cinder-quobyte-dde12d15-b620-4849-b731-0a8bd7be70c8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:37:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Acquiring lock "cinder-quobyte-7bb1c227-9af6-4bfd-9398-1723b5514a87" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:37:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Lock "cinder-quobyte-7bb1c227-9af6-4bfd-9398-1723b5514a87" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:37:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Deleting offline snapshot 7bb1c227-9af6-4bfd-9398-1723b5514a87 of volume dde12d15-b620-4849-b731-0a8bd7be70c8 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:37:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] snapshot_file for this snap is: volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:37:42 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb46631-baf7-47e4-a98b-ce2dcce26484]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:37:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:43 devstack quobyte-client[83411]: System call of process 97937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:37:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87" returned: 0 in 0.527s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:43 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dde12d15-b620-4849-b731-0a8bd7be70c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:37:43 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[56615d51-af39-4622-b4fd-cd4fef32a86a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:37:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8" returned: 0 in 0.525s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87" returned: 0 in 0.221s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8.7bb1c227-9af6-4bfd-9398-1723b5514a87" returned: 0 in 0.120s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Lock "cinder-quobyte-7bb1c227-9af6-4bfd-9398-1723b5514a87" released by "_delete_snapshot" :: held 1.772s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:37:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Lock "cinder-quobyte-dde12d15-b620-4849-b731-0a8bd7be70c8" released by "delete_snapshot" :: held 1.819s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:37:44 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Created reservations ['608f7a67-df7c-4eb6-8d52-5c27266fca00', 'e0ca8792-9727-4770-899a-87965cc36446', 'f9656c3d-b860-449e-94b6-cc4955fbcbe7', 'ef2f6ece-52a6-46a9-bf36-452d926a91ce'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:37:45 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Delete snapshot completed successfully.
Sep 16 11:37:45 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-04d8a0b7-1005-4b30-9a7f-3679e4ac96bd tempest-SnapshotMetadataTestJSON-829192873 None] Lock "cinder-7bb1c227-9af6-4bfd-9398-1723b5514a87-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:37:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Acquiring lock "cinder-dde12d15-b620-4849-b731-0a8bd7be70c8-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:37:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "cinder-dde12d15-b620-4849-b731-0a8bd7be70c8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:37:46 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:37:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Acquiring lock "cinder-quobyte-dde12d15-b620-4849-b731-0a8bd7be70c8" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:37:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "cinder-quobyte-dde12d15-b620-4849-b731-0a8bd7be70c8" acquired by "delete_volume" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:37:46 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181c366-322d-425c-a0ec-541136200dd9]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:37:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8" returned: 0 in 0.430s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dde12d15-b620-4849-b731-0a8bd7be70c8" returned: 0 in 0.104s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "cinder-quobyte-dde12d15-b620-4849-b731-0a8bd7be70c8" released by "delete_volume" :: held 0.737s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:37:47 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Created reservations ['f7e9993a-a4bf-45ef-9656-004aa52fbf03', 'fe8e69cd-911c-4c0a-9945-f570edb94cab', '449c9377-7372-4889-ac7c-a205896ce98f', '4de3cc3c-f2db-423c-a3ba-a79eaa043017'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:37:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:37:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:37:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:37:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:37:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:37:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:37:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.133s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:37:47 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:37:47 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Deleted volume successfully.
Sep 16 11:37:48 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-2ab58ec9-9b14-481d-901f-d8254723da23 tempest-SnapshotMetadataTestJSON-829192873 None] Lock "cinder-dde12d15-b620-4849-b731-0a8bd7be70c8-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:37:57 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=28,cinder:UPDATE=29,cinder:INSERT=16,cinder:DELETE=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:37:57 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:38:02 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Flow 'volume_create_manager' (dc13b87e-f1dc-4b51-bcbb-c110d1242c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681ed4fd-1903-468e-bac0-5716fc3ea8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (681ed4fd-1903-468e-bac0-5716fc3ea8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-446016612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42c01e9-70f3-42a9-a039-e68256b40688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cfe69c180a4fae8aeb452e0deed20a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:38:02Z,use_quota=True,user_id='5b11bf7256754861a185fbd05f6fd3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3dfcd4-12c5-4d77-859b-ca4ac3a529ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae3dfcd4-12c5-4d77-859b-ca4ac3a529ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a89c59-f377-474a-838b-9d32ac559790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a89c59-f377-474a-838b-9d32ac559790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd42c01e9-70f3-42a9-a039-e68256b40688', 'volume_name': 'volume-d42c01e9-70f3-42a9-a039-e68256b40688', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612ad259-aac7-4725-ac1f-29504dc695bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612ad259-aac7-4725-ac1f-29504dc695bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e3dcf4-478d-43b6-bf0b-505596c7bfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:02 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Volume d42c01e9-70f3-42a9-a039-e68256b40688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d42c01e9-70f3-42a9-a039-e68256b40688', 'volume_size': 1}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-446016612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42c01e9-70f3-42a9-a039-e68256b40688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cfe69c180a4fae8aeb452e0deed20a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:38:02Z,use_quota=True,user_id='5b11bf7256754861a185fbd05f6fd3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Creating volume d42c01e9-70f3-42a9-a039-e68256b40688 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:38:02 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:38:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d42c01e9-70f3-42a9-a039-e68256b40688 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:03 devstack quobyte-client[83411]: System call of process 98086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:38:03 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=132, name=volume-d42c01e9-70f3-42a9-a039-e68256b40688, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:38:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d42c01e9-70f3-42a9-a039-e68256b40688 1073741824" returned: 0 in 0.732s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d42c01e9-70f3-42a9-a039-e68256b40688 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d42c01e9-70f3-42a9-a039-e68256b40688" returned: 0 in 0.195s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] <== create_volume: return (1166ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:38:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:38:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e3dcf4-478d-43b6-bf0b-505596c7bfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d42c01e9-70f3-42a9-a039-e68256b40688', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f179c5a1-3c85-44a8-b4c7-0f14470f8f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:04 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Volume volume-d42c01e9-70f3-42a9-a039-e68256b40688 (d42c01e9-70f3-42a9-a039-e68256b40688): created successfully
Sep 16 11:38:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f179c5a1-3c85-44a8-b4c7-0f14470f8f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:04 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Flow 'volume_create_manager' (dc13b87e-f1dc-4b51-bcbb-c110d1242c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:38:04 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-33fe628b-cf6f-4ed8-8c56-3a9bfd69c20a tempest-VolumesTransfersTest-45066498 None] Created volume successfully.
Sep 16 11:38:06 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-54bff637-2537-44ee-ba4f-1f724b0f4652 tempest-VolumesTransfersTest-2057770990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:38:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-54bff637-2537-44ee-ba4f-1f724b0f4652 tempest-VolumesTransfersTest-2057770990 None] Transfer volume completed successfully.
Sep 16 11:38:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Acquiring lock "cinder-d42c01e9-70f3-42a9-a039-e68256b40688-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:38:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Lock "cinder-d42c01e9-70f3-42a9-a039-e68256b40688-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:38:07 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:38:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Acquiring lock "cinder-quobyte-d42c01e9-70f3-42a9-a039-e68256b40688" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:38:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Lock "cinder-quobyte-d42c01e9-70f3-42a9-a039-e68256b40688" acquired by "delete_volume" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:38:08 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f718a4-c573-41f8-a6df-710e0135bfe9]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:38:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d42c01e9-70f3-42a9-a039-e68256b40688 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d42c01e9-70f3-42a9-a039-e68256b40688" returned: 0 in 0.554s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d42c01e9-70f3-42a9-a039-e68256b40688 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d42c01e9-70f3-42a9-a039-e68256b40688" returned: 0 in 0.162s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Lock "cinder-quobyte-d42c01e9-70f3-42a9-a039-e68256b40688" released by "delete_volume" :: held 0.977s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:38:09 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Created reservations ['80961e82-9f47-41f2-86e3-bb43d2603a7b', 'fb8ef91e-ff21-4879-8ccd-24f8ad71763f', 'fadc09ef-8c26-479f-8101-50ec4f41c196', 'cccbe9eb-1a10-43d6-9e38-9746851d0377'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:38:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:38:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:38:09 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:38:09 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:38:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:38:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.149s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:09 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:38:09 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Deleted volume successfully.
Sep 16 11:38:10 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c8859f95-fd19-49dc-816c-9d5c0188e729 tempest-VolumesTransfersTest-1136865489 None] Lock "cinder-d42c01e9-70f3-42a9-a039-e68256b40688-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:38:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Flow 'volume_create_manager' (3cbf69c2-a123-4ef5-bf8f-66e841301654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d69e8e4-8979-4d8b-b729-0587a6a3be4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d69e8e4-8979-4d8b-b729-0587a6a3be4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1271011423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632d4ee7-667f-409c-ad40-8eb454f9c9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cfe69c180a4fae8aeb452e0deed20a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:38:11Z,use_quota=True,user_id='5b11bf7256754861a185fbd05f6fd3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b32d62-ec88-46fc-bdd9-2be23fd224e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b32d62-ec88-46fc-bdd9-2be23fd224e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f26c996-b81d-459d-9f2c-a0fbd62467f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f26c996-b81d-459d-9f2c-a0fbd62467f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632d4ee7-667f-409c-ad40-8eb454f9c9f2', 'volume_name': 'volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30eb7c4f-8c84-447f-9513-2ca5e057cadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30eb7c4f-8c84-447f-9513-2ca5e057cadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd43f60-6380-4e63-8f8f-ed47745d8402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:11 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Volume 632d4ee7-667f-409c-ad40-8eb454f9c9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2', 'volume_size': 1}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1271011423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632d4ee7-667f-409c-ad40-8eb454f9c9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cfe69c180a4fae8aeb452e0deed20a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:38:11Z,use_quota=True,user_id='5b11bf7256754861a185fbd05f6fd3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Creating volume 632d4ee7-667f-409c-ad40-8eb454f9c9f2 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:38:11 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:11 devstack quobyte-client[83411]: System call of process 98097 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:38:11 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=133, name=volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2 1073741824" returned: 0 in 0.434s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2" returned: 0 in 0.142s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] <== create_volume: return (651ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:38:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:38:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd43f60-6380-4e63-8f8f-ed47745d8402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec223855-e8df-4743-b583-0ab79d8b25ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:38:12 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Volume volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2 (632d4ee7-667f-409c-ad40-8eb454f9c9f2): created successfully
Sep 16 11:38:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec223855-e8df-4743-b583-0ab79d8b25ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:38:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Flow 'volume_create_manager' (3cbf69c2-a123-4ef5-bf8f-66e841301654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:38:12 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-34e26c65-f6dd-48cd-9a86-87d007f6e2a3 tempest-VolumesTransfersTest-45066498 None] Created volume successfully.
Sep 16 11:38:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Acquiring lock "cinder-632d4ee7-667f-409c-ad40-8eb454f9c9f2-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:38:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Lock "cinder-632d4ee7-667f-409c-ad40-8eb454f9c9f2-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:38:13 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:38:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Acquiring lock "cinder-quobyte-632d4ee7-667f-409c-ad40-8eb454f9c9f2" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:38:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Lock "cinder-quobyte-632d4ee7-667f-409c-ad40-8eb454f9c9f2" acquired by "delete_volume" :: waited 0.014s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:38:13 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbfd74c-a272-40f3-bc43-ab9726559d70]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:38:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2" returned: 0 in 0.591s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-632d4ee7-667f-409c-ad40-8eb454f9c9f2" returned: 0 in 0.143s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Lock "cinder-quobyte-632d4ee7-667f-409c-ad40-8eb454f9c9f2" released by "delete_volume" :: held 0.953s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:38:15 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Created reservations ['b240e410-b92c-4854-9b87-4cd5c3179dac', 'd127c2ad-24e2-4e51-95ee-ff0c006a036d', 'b6d6bc7e-ad73-43a5-bb0d-7423311beedc', '8289c5f4-b469-4e98-a76a-e088829f064f'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:38:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:38:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:38:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:38:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:38:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:38:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.102s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:15 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:38:15 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Deleted volume successfully.
Sep 16 11:38:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cb347079-5d85-4c2a-a4d1-3f0c1077009f tempest-VolumesTransfersTest-1136865489 None] Lock "cinder-632d4ee7-667f-409c-ad40-8eb454f9c9f2-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:38:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:38:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:38:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:38:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:38:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:38:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:38:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:38:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.139s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:38:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:38:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=19,cinder:SELECT=11,cinder:DELETE=3,cinder:INSERT=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:38:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=15,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:39:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-812a322c-54fa-484e-9b3c-d8ae33ec91bc req-e008d22d-e06d-4cc2-9507-4434068cfe7f tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:39:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-812a322c-54fa-484e-9b3c-d8ae33ec91bc req-e008d22d-e06d-4cc2-9507-4434068cfe7f tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:39:09 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e689ff-765a-49cf-9925-3ff776a22a63]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:39:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-812a322c-54fa-484e-9b3c-d8ae33ec91bc req-e008d22d-e06d-4cc2-9507-4434068cfe7f tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:39:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-812a322c-54fa-484e-9b3c-d8ae33ec91bc req-e008d22d-e06d-4cc2-9507-4434068cfe7f tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08" returned: 0 in 0.517s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:39:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-812a322c-54fa-484e-9b3c-d8ae33ec91bc req-e008d22d-e06d-4cc2-9507-4434068cfe7f tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.576s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:39:10 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-812a322c-54fa-484e-9b3c-d8ae33ec91bc req-e008d22d-e06d-4cc2-9507-4434068cfe7f tempest-TestServerVolumeAttachmentScenario-1725998046 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '040f8665-55bb-4eb2-ad65-e737b4fc26e4', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:39:10 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-812a322c-54fa-484e-9b3c-d8ae33ec91bc req-e008d22d-e06d-4cc2-9507-4434068cfe7f tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:39:10 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-812a322c-54fa-484e-9b3c-d8ae33ec91bc req-e008d22d-e06d-4cc2-9507-4434068cfe7f tempest-TestServerVolumeAttachmentScenario-1725998046 None] attachment_update completed successfully.
Sep 16 11:39:20 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:39:20 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.160s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-9561bccb-300a-4119-926f-118ca803f805 req-41c148a5-a252-49a4-adc5-87c57e443545 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-9561bccb-300a-4119-926f-118ca803f805 req-41c148a5-a252-49a4-adc5-87c57e443545 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9d06a3-bd36-4c8c-b88f-457bd0751846]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:39:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-9561bccb-300a-4119-926f-118ca803f805 req-41c148a5-a252-49a4-adc5-87c57e443545 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7930743a-2579-4408-a867-7f5d53a72fea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:39:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-9561bccb-300a-4119-926f-118ca803f805 req-41c148a5-a252-49a4-adc5-87c57e443545 tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7930743a-2579-4408-a867-7f5d53a72fea" returned: 0 in 0.718s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:39:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-9561bccb-300a-4119-926f-118ca803f805 req-41c148a5-a252-49a4-adc5-87c57e443545 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.806s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:39:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-9561bccb-300a-4119-926f-118ca803f805 req-41c148a5-a252-49a4-adc5-87c57e443545 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-7930743a-2579-4408-a867-7f5d53a72fea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be95325b-f115-4cf4-af3b-faa6042190cf', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:39:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-9561bccb-300a-4119-926f-118ca803f805 req-41c148a5-a252-49a4-adc5-87c57e443545 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:39:28 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-9561bccb-300a-4119-926f-118ca803f805 req-41c148a5-a252-49a4-adc5-87c57e443545 tempest-TestServerVolumeAttachmentScenario-1725998046 None] attachment_update completed successfully.
Sep 16 11:39:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=6 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:39:38 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:39:55 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-709aa28a-301e-427a-b00f-da73c4cbfbb9 req-a279d3a7-447b-444f-86da-3bbb9997c2ed tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:39:55 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-709aa28a-301e-427a-b00f-da73c4cbfbb9 req-a279d3a7-447b-444f-86da-3bbb9997c2ed tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:39:55 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-709aa28a-301e-427a-b00f-da73c4cbfbb9 req-a279d3a7-447b-444f-86da-3bbb9997c2ed tempest-TestServerVolumeAttachmentScenario-1725998046 None] Terminate volume connection completed successfully.
Sep 16 11:39:55 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-709aa28a-301e-427a-b00f-da73c4cbfbb9 req-a279d3a7-447b-444f-86da-3bbb9997c2ed tempest-TestServerVolumeAttachmentScenario-1725998046 None] Deleting attachment be95325b-f115-4cf4-af3b-faa6042190cf. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:40:05 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:40:05 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:40:19 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-c6024513-d3a3-42b1-8a81-92e70362439c req-92e46935-efdd-4571-8037-fc97b97462d7 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:40:19 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-c6024513-d3a3-42b1-8a81-92e70362439c req-92e46935-efdd-4571-8037-fc97b97462d7 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:40:19 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-c6024513-d3a3-42b1-8a81-92e70362439c req-92e46935-efdd-4571-8037-fc97b97462d7 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Terminate volume connection completed successfully.
Sep 16 11:40:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-c6024513-d3a3-42b1-8a81-92e70362439c req-92e46935-efdd-4571-8037-fc97b97462d7 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Deleting attachment 040f8665-55bb-4eb2-ad65-e737b4fc26e4. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:40:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:40:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:40:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:40:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:40:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:40:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:40:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:40:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.258s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:40:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:40:29 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:40:29 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:40:29 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Flow 'volume_create_manager' (46c43b63-0de0-4aba-b66c-2cfbb78e3fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31826d59-996d-4120-a8cb-b020d8ae0ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31826d59-996d-4120-a8cb-b020d8ae0ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-799265515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16dfa94-4a80-4833-a016-fec92fa7dbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df88cd8723248daa869087fe8f007a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:40:30Z,use_quota=True,user_id='c207a37273c04b49aedb552d591c1ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657d5230-dcec-40d6-88c2-26f94d98dbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657d5230-dcec-40d6-88c2-26f94d98dbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab06860b-7529-4f8e-9520-68cb87edc048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab06860b-7529-4f8e-9520-68cb87edc048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16dfa94-4a80-4833-a016-fec92fa7dbd0', 'volume_name': 'volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c45a8c8-0c2e-473c-abd6-f964b2a853db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c45a8c8-0c2e-473c-abd6-f964b2a853db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b952906-9192-48de-bb4c-e8b0ce8277f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:40:30 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Volume d16dfa94-4a80-4833-a016-fec92fa7dbd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0', 'volume_size': 1}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-799265515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16dfa94-4a80-4833-a016-fec92fa7dbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df88cd8723248daa869087fe8f007a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:40:30Z,use_quota=True,user_id='c207a37273c04b49aedb552d591c1ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Creating volume d16dfa94-4a80-4833-a016-fec92fa7dbd0 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:40:30 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:40:30 devstack quobyte-client[83411]: System call of process 98981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:40:30 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=134, name=volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0 1073741824" returned: 0 in 0.380s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0" returned: 0 in 0.158s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] <== create_volume: return (616ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.632s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b952906-9192-48de-bb4c-e8b0ce8277f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:40:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fa6649-0632-4110-ba09-eb46efc225bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:40:31 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Volume volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0 (d16dfa94-4a80-4833-a016-fec92fa7dbd0): created successfully
Sep 16 11:40:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fa6649-0632-4110-ba09-eb46efc225bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:40:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Flow 'volume_create_manager' (46c43b63-0de0-4aba-b66c-2cfbb78e3fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:40:31 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-61498e9f-cb28-4972-8ae8-6538e1e31566 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Created volume successfully.
Sep 16 11:40:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "cinder-7930743a-2579-4408-a867-7f5d53a72fea-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:40:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "cinder-7930743a-2579-4408-a867-7f5d53a72fea-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:40:33 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:40:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "cinder-quobyte-7930743a-2579-4408-a867-7f5d53a72fea" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:40:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "cinder-quobyte-7930743a-2579-4408-a867-7f5d53a72fea" acquired by "delete_volume" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:40:33 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f4394d-5702-428a-a420-d47d3ef968ab]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:40:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7930743a-2579-4408-a867-7f5d53a72fea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:40:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7930743a-2579-4408-a867-7f5d53a72fea" returned: 0 in 0.455s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:40:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7930743a-2579-4408-a867-7f5d53a72fea {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7930743a-2579-4408-a867-7f5d53a72fea" returned: 0 in 0.089s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "cinder-quobyte-7930743a-2579-4408-a867-7f5d53a72fea" released by "delete_volume" :: held 0.726s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Created reservations ['0d2bca37-c226-4e7d-8e67-172ba0a689b0', 'f97df582-a9f2-40ca-8b21-841d2ae32cd3', '68319829-91dd-4d4f-86bc-3eb74b9e3767', '773bbc93-ff11-4cd9-b1d3-5192dfb301fb'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.087s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:40:34 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:40:34 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Deleted volume successfully.
Sep 16 11:40:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-897b2eb9-3b56-45e0-92ed-2f9ba34cd44c tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "cinder-7930743a-2579-4408-a867-7f5d53a72fea-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:40:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "cinder-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:40:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "cinder-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:40:35 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:40:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "cinder-quobyte-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:40:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "cinder-quobyte-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08" acquired by "delete_volume" :: waited 0.034s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6cd114c5-0bb7-466a-8c87-7c3f858d8954 req-7c81fe2a-25c8-42ef-ba0e-958d77cb8072 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6cd114c5-0bb7-466a-8c87-7c3f858d8954 req-7c81fe2a-25c8-42ef-ba0e-958d77cb8072 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14b412b-36d0-4291-98c4-94013ad2de2f]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaa8496-6865-44ab-a1fd-f06e2a3fedc4]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-6cd114c5-0bb7-466a-8c87-7c3f858d8954 req-7c81fe2a-25c8-42ef-ba0e-958d77cb8072 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08" returned: 0 in 0.482s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08" returned: 0 in 0.128s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "cinder-quobyte-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08" released by "delete_volume" :: held 0.811s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-6cd114c5-0bb7-466a-8c87-7c3f858d8954 req-7c81fe2a-25c8-42ef-ba0e-958d77cb8072 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0" returned: 0 in 0.803s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:40:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-6cd114c5-0bb7-466a-8c87-7c3f858d8954 req-7c81fe2a-25c8-42ef-ba0e-958d77cb8072 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.961s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-6cd114c5-0bb7-466a-8c87-7c3f858d8954 req-7c81fe2a-25c8-42ef-ba0e-958d77cb8072 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '271e4f2c-0c27-423e-9b1d-0690433aac1a', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:40:37 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-6cd114c5-0bb7-466a-8c87-7c3f858d8954 req-7c81fe2a-25c8-42ef-ba0e-958d77cb8072 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Created reservations ['5c36f4b2-240d-4279-a1d3-7f3f6dfac298', 'b81bbe41-0757-4f9c-b329-b55bd030b37e', '3513bd4c-a3d3-4a3c-82ad-02ec37286e3e', 'fa33b263-e1bc-4eac-bc3a-d7250898dee7'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:40:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-6cd114c5-0bb7-466a-8c87-7c3f858d8954 req-7c81fe2a-25c8-42ef-ba0e-958d77cb8072 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] attachment_update completed successfully.
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.088s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:40:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Deleted volume successfully.
Sep 16 11:40:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5afb1847-244b-4aff-813b-18c83a8ac370 tempest-TestServerVolumeAttachmentScenario-1725998046 None] Lock "cinder-21c3f301-de17-4ebc-a2ab-12a0b8cf2a08-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:40:47 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:40:47 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=17,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:41:07 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-1a0bad9d-39f6-4387-af8e-f86d0b0b58af req-00c7ea62-94eb-41b6-b589-83bf9be6765a tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:41:07 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-1a0bad9d-39f6-4387-af8e-f86d0b0b58af req-00c7ea62-94eb-41b6-b589-83bf9be6765a tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:41:07 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-1a0bad9d-39f6-4387-af8e-f86d0b0b58af req-00c7ea62-94eb-41b6-b589-83bf9be6765a tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Terminate volume connection completed successfully.
Sep 16 11:41:07 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-1a0bad9d-39f6-4387-af8e-f86d0b0b58af req-00c7ea62-94eb-41b6-b589-83bf9be6765a tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Deleting attachment 271e4f2c-0c27-423e-9b1d-0690433aac1a. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:41:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Acquiring lock "cinder-d16dfa94-4a80-4833-a016-fec92fa7dbd0-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:41:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "cinder-d16dfa94-4a80-4833-a016-fec92fa7dbd0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:41:09 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:41:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Acquiring lock "cinder-quobyte-d16dfa94-4a80-4833-a016-fec92fa7dbd0" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:41:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "cinder-quobyte-d16dfa94-4a80-4833-a016-fec92fa7dbd0" acquired by "delete_volume" :: waited 0.014s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:41:09 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65c7b6e-f384-419b-b963-be7444546d58]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:41:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0" returned: 0 in 0.504s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d16dfa94-4a80-4833-a016-fec92fa7dbd0" returned: 0 in 0.136s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "cinder-quobyte-d16dfa94-4a80-4833-a016-fec92fa7dbd0" released by "delete_volume" :: held 0.832s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:41:10 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Created reservations ['eeaed402-c797-477b-bcde-441d3c56edfb', '25ae8e59-9a0c-4815-825c-a453e7e061bd', 'bceeaa6d-1fc4-4c49-8e7f-69f91d60565e', 'd1c5f651-feb9-4544-bdce-e30e52a1f07e'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:41:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:41:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:41:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:41:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:41:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:41:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.093s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:10 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:41:10 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Deleted volume successfully.
Sep 16 11:41:10 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e86f675c-290b-4aa7-aeed-348a41c6d529 tempest-TestServerVolumeAttachScenarioOldVersion-1240672491 None] Lock "cinder-d16dfa94-4a80-4833-a016-fec92fa7dbd0-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:41:20 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=12 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:41:20 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:41:25 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:41:25 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Flow 'volume_create_manager' (2f1661f7-d048-4032-ae5b-ff1b7633ece0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961a991c-48bd-44b6-aaa1-1362daebd3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961a991c-48bd-44b6-aaa1-1362daebd3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1570470627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0b7baef07e42cfa0896380adf00200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:41:26Z,use_quota=True,user_id='baa422a12e064607b10d76b71451d825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8121ba2c-7929-466a-9e53-e35764d899cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8121ba2c-7929-466a-9e53-e35764d899cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c486c28-6690-465d-8c95-a8b9ce230b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.583s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:41:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c486c28-6690-465d-8c95-a8b9ce230b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3', 'volume_name': 'volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff892ed1660>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:41:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fab8655-648c-4478-a25e-2513a1bfd1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:41:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fab8655-648c-4478-a25e-2513a1bfd1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:41:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c96fe7-720c-4447-b818-acfb5de99cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:41:27 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Volume ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff892ed1660>}
Sep 16 11:41:27 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Cloning ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 from image ae172bdc-0a7f-403f-a999-85b28d841ddd  at location (None, None). {{(pid=83386) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 16 11:41:27 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 16 11:41:27 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Image download 20.69 MB at 20.69 MB/s
Sep 16 11:41:27 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b315c7-0995-4a4c-ad80-29ff7c360651]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:41:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:28 devstack sudo[99537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD
Sep 16 11:41:28 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:41:30 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root
Sep 16 11:41:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD" returned: 0 in 2.771s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:30 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Temporary image ae172bdc-0a7f-403f-a999-85b28d841ddd is fetched for user baa422a12e064607b10d76b71451d825. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 16 11:41:31 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ef5934-cfb1-4d33-8e94-507a04a8dad3]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:41:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:31 devstack sudo[99543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD
Sep 16 11:41:31 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:41:33 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD" returned: 0 in 2.534s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1570470627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed0b7baef07e42cfa0896380adf00200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:41:26Z,use_quota=True,user_id='baa422a12e064607b10d76b71451d825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Creating volume ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:41:33 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:41:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:34 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=135, name=volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:41:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 1073741824" returned: 0 in 0.417s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 0 in 0.110s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] <== create_volume: return (639ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:41:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:41:34 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Attempting download of ae172bdc-0a7f-403f-a999-85b28d841ddd ((None, None)) to volume ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 16 11:41:35 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[d231b888-4d16-4878-8653-506aa2b7728e]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:41:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_9i9qv51z {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_9i9qv51z" returned: 0 in 0.626s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_9i9qv51z {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_9i9qv51z" returned: 1 in 0.444s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae172bdc-0a7f-403f-a999-85b28d841ddd_9i9qv51z' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:41:36 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c840ffb-7bc2-4294-8ad2-485475effad8]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:41:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:36 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] ae172bdc-0a7f-403f-a999-85b28d841ddd was qcow2, converting to raw {{(pid=83386) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 16 11:41:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:36 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=135, name=volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:41:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 0 in 1.516s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:38 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae172bdc-0a7f-403f-a999-85b28d841ddd_w4eagxxbdevstack@QuobyteHD, size 112.00 MB, duration 1.54 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:41:38 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Converted 112.00 MB image at 72.65 MB/s
Sep 16 11:41:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 1G" returned: 0 in 0.158s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:38 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a582ef-328c-4764-9968-ee715878441e]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:41:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 0 in 0.386s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 1 in 0.492s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Downloaded image ae172bdc-0a7f-403f-a999-85b28d841ddd ((None, None)) to volume ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 successfully. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Temporary image ae172bdc-0a7f-403f-a999-85b28d841ddd for user baa422a12e064607b10d76b71451d825 is deleted. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Marking volume ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 as bootable. {{(pid=83386) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Copying metadata from image ae172bdc-0a7f-403f-a999-85b28d841ddd to ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3. {{(pid=83386) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Creating volume glance metadata for volume ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 backed by image ae172bdc-0a7f-403f-a999-85b28d841ddd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83386) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c96fe7-720c-4447-b818-acfb5de99cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3', 'volume_size': 1, 'image_id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e13a129bf25f421eb61cb88145412f58', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ae172bdc-0a7f-403f-a999-85b28d841ddd', 'created_at': datetime.datetime(2025, 9, 16, 8, 58, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 8, 58, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae172bdc-0a7f-403f-a999-85b28d841ddd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff892ed1660>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0a5310-be74-43f5-a074-bd133ee6882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:41:39 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Volume volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 (ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3): created successfully
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b0a5310-be74-43f5-a074-bd133ee6882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:41:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Flow 'volume_create_manager' (2f1661f7-d048-4032-ae5b-ff1b7633ece0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:41:39 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-a423a244-ff2b-4a1e-8b69-91890c0cd096 tempest-TestShelveInstance-426218303 None] Created volume successfully.
Sep 16 11:41:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:41:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:41:49 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=9,cinder:INSERT=7,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:41:50 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b811d6-81b6-4a23-8fc1-5dd684525e27]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:41:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 0 in 0.561s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:41:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 1 in 0.627s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:41:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:41:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.354s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:41:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98b83505-a9d8-4199-84bd-410d5c5582d4', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:41:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:41:51 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-716703fc-e2e1-4246-af00-7e8edbfbcaa3 req-da03e09c-109f-462d-ac04-a50edaae961d tempest-TestShelveInstance-426218303 None] attachment_update completed successfully.
Sep 16 11:42:01 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=6 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:42:01 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:42:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:42:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:42:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:42:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:42:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:42:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:42:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:42:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.100s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:42:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:42:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:42:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:43:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b232c564-b89e-4a62-bbff-db91080eab9d req-8bae1cb6-4e0a-4992-b3c7-43fa2664d989 tempest-TestShelveInstance-426218303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:43:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b232c564-b89e-4a62-bbff-db91080eab9d req-8bae1cb6-4e0a-4992-b3c7-43fa2664d989 tempest-TestShelveInstance-426218303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:43:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-b232c564-b89e-4a62-bbff-db91080eab9d req-8bae1cb6-4e0a-4992-b3c7-43fa2664d989 tempest-TestShelveInstance-426218303 None] Terminate volume connection completed successfully.
Sep 16 11:43:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-b232c564-b89e-4a62-bbff-db91080eab9d req-8bae1cb6-4e0a-4992-b3c7-43fa2664d989 tempest-TestShelveInstance-426218303 None] Deleting attachment 98b83505-a9d8-4199-84bd-410d5c5582d4. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:43:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:43:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:43:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:43:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:43:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:43:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:43:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:43:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.139s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:43:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:43:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:43:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:43:29 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[97733395-f0f4-4c04-b1cb-466f887e5a70]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:43:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:43:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 0 in 0.380s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:43:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:43:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 1 in 0.360s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:43:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:43:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:43:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd', 'name': 'volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ac6e5cd-124b-444c-86bc-151ac47d9a67', 'enforce_multipath': True} {{(pid=83386) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 16 11:43:30 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:43:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-b85b6481-ab8e-4d69-be52-538a30ee072c req-a802a6af-3ac0-4380-bbad-bdf5abc88c66 tempest-TestShelveInstance-426218303 None] attachment_update completed successfully.
Sep 16 11:43:40 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:43:40 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:44:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:44:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:44:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:44:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:44:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:44:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:44:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:44:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.107s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:44:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:44:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:44:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:45:06 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-c0591869-d2c8-4830-b4d2-41401d5f76ad tempest-TestShelveInstance-426218303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:06 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-c0591869-d2c8-4830-b4d2-41401d5f76ad tempest-TestShelveInstance-426218303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-c0591869-d2c8-4830-b4d2-41401d5f76ad tempest-TestShelveInstance-426218303 None] Terminate volume connection completed successfully.
Sep 16 11:45:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-c0591869-d2c8-4830-b4d2-41401d5f76ad tempest-TestShelveInstance-426218303 None] Deleting attachment 1ac6e5cd-124b-444c-86bc-151ac47d9a67. {{(pid=83386) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 16 11:45:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Acquiring lock "cinder-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Lock "cinder-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:07 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Acquiring lock "cinder-quobyte-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Lock "cinder-quobyte-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" acquired by "delete_volume" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:07 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[013baf27-934a-4e66-81ca-96bff009cac6]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:45:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 0 in 0.435s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 1 in 0.367s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" returned: 0 in 0.102s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Lock "cinder-quobyte-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3" released by "delete_volume" :: held 1.153s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG cinder.quota [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Created reservations ['736e94db-6e3a-4eaf-9646-7a30e69d7d4a', 'b67bf91c-dd97-4395-889b-9ab377456e1f', 'ee66cf17-5ac1-4545-8cbf-3aa6f0eaddb3', 'ba676fc6-d42d-40c2-9270-8c285b2c26d9'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.108s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:09 devstack cinder-volume[83386]: DEBUG cinder.manager [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:45:09 devstack cinder-volume[83386]: INFO cinder.volume.manager [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Deleted volume successfully.
Sep 16 11:45:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [req-5edda77c-86e3-46fe-897e-280e8e06e81f req-135eac54-fd84-45ab-ab92-b5205c90ea3d tempest-TestShelveInstance-426218303 None] Lock "cinder-ee8aa944-b9c6-4ad4-85e5-87fc6ed90ff3-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:18 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:45:19 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:45:25 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Flow 'volume_create_manager' (feba25be-1f77-46f6-8988-1dc937557b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ba577b-4fbb-45c9-9aa6-f96aa795304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ba577b-4fbb-45c9-9aa6-f96aa795304a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-276125850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec05077-86cb-492e-8692-61ef7acd49c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bf43bd309241a999462864ceffa64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:25Z,use_quota=True,user_id='8e5ffa102a064dbc9d6c1f359691e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cccc27a9-2b04-46f6-b44e-6746cd0035f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cccc27a9-2b04-46f6-b44e-6746cd0035f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf052f7d-2d8c-4b3a-8c9d-5ad4c18eb6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf052f7d-2d8c-4b3a-8c9d-5ad4c18eb6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec05077-86cb-492e-8692-61ef7acd49c2', 'volume_name': 'volume-7ec05077-86cb-492e-8692-61ef7acd49c2', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9d28a7-9eaf-4d2e-805e-67fad2e397ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9d28a7-9eaf-4d2e-805e-67fad2e397ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc35293-5e94-41fa-af89-a1932b681f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:25 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Volume 7ec05077-86cb-492e-8692-61ef7acd49c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec05077-86cb-492e-8692-61ef7acd49c2', 'volume_size': 1}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-276125850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec05077-86cb-492e-8692-61ef7acd49c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bf43bd309241a999462864ceffa64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:25Z,use_quota=True,user_id='8e5ffa102a064dbc9d6c1f359691e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Creating volume 7ec05077-86cb-492e-8692-61ef7acd49c2 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:45:25 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:45:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7ec05077-86cb-492e-8692-61ef7acd49c2 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:25 devstack quobyte-client[83411]: System call of process 101034 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:45:26 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=136, name=volume-7ec05077-86cb-492e-8692-61ef7acd49c2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:45:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:45:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7ec05077-86cb-492e-8692-61ef7acd49c2 1073741824" returned: 0 in 0.780s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7ec05077-86cb-492e-8692-61ef7acd49c2 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.522s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:45:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Flow 'volume_create_manager' (2b3bd1a8-7f0d-4b24-92de-22f9f9afe18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5016cd4-b941-4186-82ce-c5038aa5e748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Flow 'volume_create_manager' (820beb6f-e9dd-4c1f-8498-a9b6b583a077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec198bb-cfad-4afd-9f6f-89aa2cee0f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7ec05077-86cb-492e-8692-61ef7acd49c2" returned: 0 in 0.606s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] <== create_volume: return (1488ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5016cd4-b941-4186-82ce-c5038aa5e748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918302168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc11806b-395a-4561-a76e-0edc6a944492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bf43bd309241a999462864ceffa64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:26Z,use_quota=True,user_id='8e5ffa102a064dbc9d6c1f359691e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ebba5e-febd-408b-b975-492a04646870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ebba5e-febd-408b-b975-492a04646870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff083b08-0c87-455d-b9f2-ab76aedb9a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff083b08-0c87-455d-b9f2-ab76aedb9a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc11806b-395a-4561-a76e-0edc6a944492', 'volume_name': 'volume-bc11806b-395a-4561-a76e-0edc6a944492', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095b8bd3-636e-44bf-888b-0d31ebbb623d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095b8bd3-636e-44bf-888b-0d31ebbb623d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf17fdc-2b89-45a8-868d-10f8429196f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Volume bc11806b-395a-4561-a76e-0edc6a944492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc11806b-395a-4561-a76e-0edc6a944492', 'volume_size': 1}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918302168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc11806b-395a-4561-a76e-0edc6a944492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bf43bd309241a999462864ceffa64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:26Z,use_quota=True,user_id='8e5ffa102a064dbc9d6c1f359691e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Creating volume bc11806b-395a-4561-a76e-0edc6a944492 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:45:27 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bc11806b-395a-4561-a76e-0edc6a944492 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:27 devstack quobyte-client[83411]: System call of process 101039 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:45:27 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=137, name=volume-bc11806b-395a-4561-a76e-0edc6a944492, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec198bb-cfad-4afd-9f6f-89aa2cee0f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1808980668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0aa036-0fea-4318-9097-d73596bdafa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bf43bd309241a999462864ceffa64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:27Z,use_quota=True,user_id='8e5ffa102a064dbc9d6c1f359691e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d69d75-06c5-40ef-8760-a79a14e5c639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d69d75-06c5-40ef-8760-a79a14e5c639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231fafa7-3502-43b8-bbba-af3069681fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231fafa7-3502-43b8-bbba-af3069681fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc0aa036-0fea-4318-9097-d73596bdafa6', 'volume_name': 'volume-cc0aa036-0fea-4318-9097-d73596bdafa6', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc48e7d-cecb-4a73-8a1d-0a7a38bc6ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc48e7d-cecb-4a73-8a1d-0a7a38bc6ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db10e05-65cd-42cb-96bf-cb7a4744bbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Volume cc0aa036-0fea-4318-9097-d73596bdafa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc0aa036-0fea-4318-9097-d73596bdafa6', 'volume_size': 1}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc35293-5e94-41fa-af89-a1932b681f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec05077-86cb-492e-8692-61ef7acd49c2', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dff127-02df-451c-b512-744ec11a9e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:27 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Flow 'volume_create_manager' (c895dba4-48cf-45a6-9648-81db7582766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5b6ee9-9687-49f9-80e8-c7ba1227b13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bc11806b-395a-4561-a76e-0edc6a944492 1073741824" returned: 0 in 0.709s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bc11806b-395a-4561-a76e-0edc6a944492 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5b6ee9-9687-49f9-80e8-c7ba1227b13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-580312823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bf43bd309241a999462864ceffa64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:27Z,use_quota=True,user_id='8e5ffa102a064dbc9d6c1f359691e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a19a9b-af05-4623-9172-c459c77650b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a19a9b-af05-4623-9172-c459c77650b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf67455-6f0a-4d7f-afad-d65c2d8ed5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf67455-6f0a-4d7f-afad-d65c2d8ed5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b', 'volume_name': 'volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4352ff-7186-4051-a486-781a89841905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4352ff-7186-4051-a486-781a89841905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd3c797-0c17-412a-8341-24651d874234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:28 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Volume 1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b', 'volume_size': 1}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:28 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Volume volume-7ec05077-86cb-492e-8692-61ef7acd49c2 (7ec05077-86cb-492e-8692-61ef7acd49c2): created successfully
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dff127-02df-451c-b512-744ec11a9e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Flow 'volume_create_manager' (feba25be-1f77-46f6-8988-1dc937557b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:28 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Flow 'volume_create_manager' (0b739556-7f87-42b8-83c7-ed311cc5dd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117cb357-2861-4902-98bc-a9c40aeeb712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:28 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d888cbbd-aec7-47d0-a9be-a92e84cfb55a tempest-CreateVolumesFromImageTest-768589116 None] Created volume successfully.
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bc11806b-395a-4561-a76e-0edc6a944492" returned: 0 in 0.527s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] <== create_volume: return (1253ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117cb357-2861-4902-98bc-a9c40aeeb712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38036803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcbac0f-b659-4bfe-82fb-31a1df943a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bf43bd309241a999462864ceffa64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:28Z,use_quota=True,user_id='8e5ffa102a064dbc9d6c1f359691e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f2c00b-475f-40f4-a4c1-9572e988da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f2c00b-475f-40f4-a4c1-9572e988da6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db479205-7d4c-4138-9eda-c189baf02f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db479205-7d4c-4138-9eda-c189baf02f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fcbac0f-b659-4bfe-82fb-31a1df943a1f', 'volume_name': 'volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819a9dbf-3cf4-473d-9d80-63d85ff5feae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819a9dbf-3cf4-473d-9d80-63d85ff5feae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698ae437-3029-459b-a6cc-075bd1815aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:28 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Volume 4fcbac0f-b659-4bfe-82fb-31a1df943a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f', 'volume_size': 1}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38036803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcbac0f-b659-4bfe-82fb-31a1df943a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bf43bd309241a999462864ceffa64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:28Z,use_quota=True,user_id='8e5ffa102a064dbc9d6c1f359691e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Creating volume 4fcbac0f-b659-4bfe-82fb-31a1df943a1f {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:45:28 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:45:28 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:28 devstack quobyte-client[83411]: System call of process 101043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:45:28 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=138, name=volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf17fdc-2b89-45a8-868d-10f8429196f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc11806b-395a-4561-a76e-0edc6a944492', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea38da8-f5f3-4345-b2d3-029aca58d87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f 1073741824" returned: 0 in 0.469s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:29 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Volume volume-bc11806b-395a-4561-a76e-0edc6a944492 (bc11806b-395a-4561-a76e-0edc6a944492): created successfully
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea38da8-f5f3-4345-b2d3-029aca58d87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Flow 'volume_create_manager' (2b3bd1a8-7f0d-4b24-92de-22f9f9afe18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f" returned: 0 in 0.311s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] <== create_volume: return (810ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.132s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-580312823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bf43bd309241a999462864ceffa64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:27Z,use_quota=True,user_id='8e5ffa102a064dbc9d6c1f359691e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Creating volume 1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:45:29 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:29 devstack quobyte-client[83411]: System call of process 101047 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:45:29 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=139, name=volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:45:29 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e90a8f5e-bd17-4418-a1c2-363235cccea5 tempest-CreateVolumesFromImageTest-768589116 None] Created volume successfully.
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698ae437-3029-459b-a6cc-075bd1815aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d3b96b-3ede-4431-96b5-83aa575146c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:29 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Volume volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f (4fcbac0f-b659-4bfe-82fb-31a1df943a1f): created successfully
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d3b96b-3ede-4431-96b5-83aa575146c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Flow 'volume_create_manager' (0b739556-7f87-42b8-83c7-ed311cc5dd95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b 1073741824" returned: 0 in 0.418s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-1f56a3e8-3344-4683-b7ba-fdd0e7a2aeac tempest-CreateVolumesFromImageTest-768589116 None] Created volume successfully.
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b" returned: 0 in 0.264s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] <== create_volume: return (707ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.296s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1808980668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc0aa036-0fea-4318-9097-d73596bdafa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bf43bd309241a999462864ceffa64f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:27Z,use_quota=True,user_id='8e5ffa102a064dbc9d6c1f359691e56c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Creating volume cc0aa036-0fea-4318-9097-d73596bdafa6 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:45:30 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cc0aa036-0fea-4318-9097-d73596bdafa6 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:30 devstack quobyte-client[83411]: System call of process 101051 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:45:30 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=140, name=volume-cc0aa036-0fea-4318-9097-d73596bdafa6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd3c797-0c17-412a-8341-24651d874234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998aeea4-4582-4302-b925-8103cbf8427b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:30 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Volume volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b (1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b): created successfully
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998aeea4-4582-4302-b925-8103cbf8427b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Flow 'volume_create_manager' (c895dba4-48cf-45a6-9648-81db7582766a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cc0aa036-0fea-4318-9097-d73596bdafa6 1073741824" returned: 0 in 0.387s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cc0aa036-0fea-4318-9097-d73596bdafa6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cc0aa036-0fea-4318-9097-d73596bdafa6" returned: 0 in 0.145s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] <== create_volume: return (579ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.599s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-9de0eae7-72eb-4a90-9b04-53ec90f969fb tempest-CreateVolumesFromImageTest-768589116 None] Created volume successfully.
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db10e05-65cd-42cb-96bf-cb7a4744bbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc0aa036-0fea-4318-9097-d73596bdafa6', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:30 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e442e05-9ce6-4655-95ea-45b567f13e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:31 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Volume volume-cc0aa036-0fea-4318-9097-d73596bdafa6 (cc0aa036-0fea-4318-9097-d73596bdafa6): created successfully
Sep 16 11:45:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e442e05-9ce6-4655-95ea-45b567f13e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:31 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Flow 'volume_create_manager' (820beb6f-e9dd-4c1f-8498-a9b6b583a077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:31 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-a18f9d59-f99c-4f3e-9481-90ce5d212260 tempest-CreateVolumesFromImageTest-768589116 None] Created volume successfully.
Sep 16 11:45:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "cinder-4fcbac0f-b659-4bfe-82fb-31a1df943a1f-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-4fcbac0f-b659-4bfe-82fb-31a1df943a1f-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:31 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "cinder-quobyte-4fcbac0f-b659-4bfe-82fb-31a1df943a1f" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-quobyte-4fcbac0f-b659-4bfe-82fb-31a1df943a1f" acquired by "delete_volume" :: waited 0.014s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:31 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cf75a1-7a2e-4354-acea-e16fd230a610]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:45:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f" returned: 0 in 0.402s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-4fcbac0f-b659-4bfe-82fb-31a1df943a1f" returned: 0 in 0.088s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-quobyte-4fcbac0f-b659-4bfe-82fb-31a1df943a1f" released by "delete_volume" :: held 0.639s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Created reservations ['4954cc56-a8f3-415b-8293-2630ac0cfff7', 'be5d70d5-fa40-4201-a210-0bb0f008e107', '2dd2eaa8-2bbf-4762-9d1d-0c287c82f80d', 'd3f1a69a-5962-4168-80f8-9d5407738a74'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.089s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:33 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:45:33 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Deleted volume successfully.
Sep 16 11:45:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-851d6b0c-c6c2-44f3-bcfc-148e24abcbbf tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-4fcbac0f-b659-4bfe-82fb-31a1df943a1f-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "cinder-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:34 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "cinder-quobyte-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-quobyte-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b" acquired by "delete_volume" :: waited 0.022s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:34 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a28842c-c19f-4836-b390-c5ad2bd67aa1]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:45:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b" returned: 0 in 0.400s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b" returned: 0 in 0.094s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-quobyte-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b" released by "delete_volume" :: held 0.667s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:35 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Created reservations ['fcde5cee-ab61-446b-9847-8daddeaaf010', '25313bfb-af6c-4d62-82ec-0ca103f958f5', '01280fbb-129a-4cd0-b774-bfbadaf3c162', '96e2d25c-89bd-42b8-8dd1-28a22e3879a8'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:45:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:35 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.092s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:35 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:45:35 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Deleted volume successfully.
Sep 16 11:45:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37519c52-e169-4465-bfbe-867b4b46f032 tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-1f9efde7-5576-4bfa-bcc5-ce43f5d60d6b-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "cinder-cc0aa036-0fea-4318-9097-d73596bdafa6-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-cc0aa036-0fea-4318-9097-d73596bdafa6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:36 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "cinder-quobyte-cc0aa036-0fea-4318-9097-d73596bdafa6" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-quobyte-cc0aa036-0fea-4318-9097-d73596bdafa6" acquired by "delete_volume" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:36 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14f0303-237c-4b8d-92e8-2fdc850559f1]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:45:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cc0aa036-0fea-4318-9097-d73596bdafa6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cc0aa036-0fea-4318-9097-d73596bdafa6" returned: 0 in 0.406s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cc0aa036-0fea-4318-9097-d73596bdafa6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-cc0aa036-0fea-4318-9097-d73596bdafa6" returned: 0 in 0.104s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-quobyte-cc0aa036-0fea-4318-9097-d73596bdafa6" released by "delete_volume" :: held 0.647s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Created reservations ['6d45f37b-1e92-40df-8f02-94a8179d1c0b', 'd264200f-f443-4c9c-9560-3fc4dafeef52', 'd44d5ec3-1162-4801-b42f-39966f5bbbdc', '2a2c77ed-ba49-4bb8-be93-e7295c194c24'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.127s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:45:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Deleted volume successfully.
Sep 16 11:45:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-806952fc-6376-4842-b29d-43de8ba6bcdf tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-cc0aa036-0fea-4318-9097-d73596bdafa6-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "cinder-bc11806b-395a-4561-a76e-0edc6a944492-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-bc11806b-395a-4561-a76e-0edc6a944492-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:38 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "cinder-quobyte-bc11806b-395a-4561-a76e-0edc6a944492" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-quobyte-bc11806b-395a-4561-a76e-0edc6a944492" acquired by "delete_volume" :: waited 0.012s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:38 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00a850d-8158-4bdc-8818-5fafed09d701]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:45:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bc11806b-395a-4561-a76e-0edc6a944492 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bc11806b-395a-4561-a76e-0edc6a944492" returned: 0 in 0.391s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bc11806b-395a-4561-a76e-0edc6a944492 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-bc11806b-395a-4561-a76e-0edc6a944492" returned: 0 in 0.127s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-quobyte-bc11806b-395a-4561-a76e-0edc6a944492" released by "delete_volume" :: held 0.666s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Created reservations ['9168b801-ef2c-459e-b1b7-70da838e7329', 'bffd46a5-8cdf-4888-9512-979da3e705c1', 'd3aadc8c-0e97-4d91-9515-76a2c32a89d2', '0eea0ec1-6609-441c-a0aa-92b4c9dae361'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.107s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:39 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:45:39 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Deleted volume successfully.
Sep 16 11:45:40 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b2bdb63f-f010-47df-8aa3-ccf145d09893 tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-bc11806b-395a-4561-a76e-0edc6a944492-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:40 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "cinder-7ec05077-86cb-492e-8692-61ef7acd49c2-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:40 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-7ec05077-86cb-492e-8692-61ef7acd49c2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:41 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "cinder-quobyte-7ec05077-86cb-492e-8692-61ef7acd49c2" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:45:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-quobyte-7ec05077-86cb-492e-8692-61ef7acd49c2" acquired by "delete_volume" :: waited 0.014s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:45:41 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675086e-2eb4-4a13-960f-1b56c4e0392b]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:45:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7ec05077-86cb-492e-8692-61ef7acd49c2 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7ec05077-86cb-492e-8692-61ef7acd49c2" returned: 0 in 0.395s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7ec05077-86cb-492e-8692-61ef7acd49c2 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7ec05077-86cb-492e-8692-61ef7acd49c2" returned: 0 in 0.091s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:41 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-quobyte-7ec05077-86cb-492e-8692-61ef7acd49c2" released by "delete_volume" :: held 0.638s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:42 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Created reservations ['69da88e9-5bdc-4948-a463-1ecaf4bdb9e8', '488e3007-5c00-465d-aa35-e49e5a3f9ace', 'f1e1ba95-d496-447f-8496-604ec44f133f', 'ee5e50e9-315d-4639-9f73-907755dffca5'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:45:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.088s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:42 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:45:42 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Deleted volume successfully.
Sep 16 11:45:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d8bb91a6-ca6a-4b1a-86f1-fdb840e712fd tempest-CreateVolumesFromImageTest-768589116 None] Lock "cinder-7ec05077-86cb-492e-8692-61ef7acd49c2-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:45:48 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:45:48 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:45:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Flow 'volume_create_manager' (95cb450a-34a9-4a6b-864c-81b155211515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:45:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110dafa3-1041-4dbe-bf15-5245482bd135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110dafa3-1041-4dbe-bf15-5245482bd135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad3d520-13ed-4309-843f-3a48e64635fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7137199c4f674baf9e015a239f28e692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:49Z,use_quota=True,user_id='60d33a1ebe0142b2bb3c544b11385a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b9606c-eb4d-46a2-a9d0-d9937470b1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b9606c-eb4d-46a2-a9d0-d9937470b1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1aad97b-ece5-4f8e-9127-b19f1c103e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1aad97b-ece5-4f8e-9127-b19f1c103e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dad3d520-13ed-4309-843f-3a48e64635fe', 'volume_name': 'volume-dad3d520-13ed-4309-843f-3a48e64635fe', 'volume_size': 1, 'image_id': '8c1be9b3-f581-484f-b2c9-c1898f5afe8e', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f83f431d3935213f9df201877a7917de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7137199c4f674baf9e015a239f28e692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4099a0a16593b35cb4357bd4af77649d9c729f9feb00dd59493a22dffeea519f1dc52392d066dd957ce2505e13514ad2470254575cef88167fe62e71bbc2be1', 'id': '8c1be9b3-f581-484f-b2c9-c1898f5afe8e', 'created_at': datetime.datetime(2025, 9, 16, 9, 45, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 9, 45, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c1be9b3-f581-484f-b2c9-c1898f5afe8e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8933c91e0>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ee1fc6-b1b4-4524-bbf1-16d80b483d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89ee1fc6-b1b4-4524-bbf1-16d80b483d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:45:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd91f61-fd10-4496-8c70-648f7991f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:45:49 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Volume dad3d520-13ed-4309-843f-3a48e64635fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dad3d520-13ed-4309-843f-3a48e64635fe', 'volume_size': 1, 'image_id': '8c1be9b3-f581-484f-b2c9-c1898f5afe8e', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f83f431d3935213f9df201877a7917de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7137199c4f674baf9e015a239f28e692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4099a0a16593b35cb4357bd4af77649d9c729f9feb00dd59493a22dffeea519f1dc52392d066dd957ce2505e13514ad2470254575cef88167fe62e71bbc2be1', 'id': '8c1be9b3-f581-484f-b2c9-c1898f5afe8e', 'created_at': datetime.datetime(2025, 9, 16, 9, 45, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 9, 45, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c1be9b3-f581-484f-b2c9-c1898f5afe8e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8933c91e0>}
Sep 16 11:45:49 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Cloning dad3d520-13ed-4309-843f-3a48e64635fe from image 8c1be9b3-f581-484f-b2c9-c1898f5afe8e  at location (None, None). {{(pid=83386) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 16 11:45:49 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 16 11:45:49 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 11:45:49 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d970eba-375e-4e24-8357-23500f6c67f9]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:45:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:49 devstack sudo[101084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD
Sep 16 11:45:49 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:45:51 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root
Sep 16 11:45:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD" returned: 0 in 2.041s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:52 devstack sudo[101089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD
Sep 16 11:45:52 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:45:53 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root
Sep 16 11:45:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD" returned: 1 in 2.391s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:45:53 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Temporary image 8c1be9b3-f581-484f-b2c9-c1898f5afe8e is fetched for user 60d33a1ebe0142b2bb3c544b11385a3a. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 16 11:45:54 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[803de8c7-21d0-4c22-9499-65b95aae87f3]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:45:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:54 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD
Sep 16 11:45:54 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:45:56 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Sep 16 11:45:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD" returned: 0 in 2.059s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:56 devstack sudo[101100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD
Sep 16 11:45:56 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:45:58 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD" returned: 1 in 1.874s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad3d520-13ed-4309-843f-3a48e64635fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7137199c4f674baf9e015a239f28e692',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:45:49Z,use_quota=True,user_id='60d33a1ebe0142b2bb3c544b11385a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Creating volume dad3d520-13ed-4309-843f-3a48e64635fe {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:45:58 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:58 devstack quobyte-client[83411]: System call of process 101105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:45:58 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=141, name=volume-dad3d520-13ed-4309-843f-3a48e64635fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe 1073741824" returned: 0 in 0.363s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe" returned: 0 in 0.087s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] <== create_volume: return (548ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.587s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:45:58 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Attempting download of 8c1be9b3-f581-484f-b2c9-c1898f5afe8e ((None, None)) to volume dad3d520-13ed-4309-843f-3a48e64635fe. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 16 11:45:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef807424-686f-45a1-b17c-58018c6ce8ea]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:45:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_8btgcde6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_8btgcde6" returned: 0 in 0.380s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_8btgcde6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:45:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_8btgcde6" returned: 1 in 0.362s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:45:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_8btgcde6' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:45:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f81407-3ba7-4439-8c40-47f17d751e29]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:45:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:46:00 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] 8c1be9b3-f581-484f-b2c9-c1898f5afe8e was raw, converting to raw {{(pid=83386) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 16 11:46:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:00 devstack quobyte-client[83411]: System call of process 101118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:46:00 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=141, name=volume-dad3d520-13ed-4309-843f-3a48e64635fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe" returned: 0 in 0.178s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:01 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c1be9b3-f581-484f-b2c9-c1898f5afe8e_pkzqq93edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:46:01 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 11:46:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe 1G" returned: 0 in 0.128s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:01 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ee8b49-ef8b-433c-871b-b2c89373eead]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:46:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe" returned: 0 in 0.381s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe" returned: 1 in 0.366s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Downloaded image 8c1be9b3-f581-484f-b2c9-c1898f5afe8e ((None, None)) to volume dad3d520-13ed-4309-843f-3a48e64635fe successfully. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Temporary image 8c1be9b3-f581-484f-b2c9-c1898f5afe8e for user 60d33a1ebe0142b2bb3c544b11385a3a is deleted. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Marking volume dad3d520-13ed-4309-843f-3a48e64635fe as bootable. {{(pid=83386) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Copying metadata from image 8c1be9b3-f581-484f-b2c9-c1898f5afe8e to dad3d520-13ed-4309-843f-3a48e64635fe. {{(pid=83386) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Creating volume glance metadata for volume dad3d520-13ed-4309-843f-3a48e64635fe backed by image 8c1be9b3-f581-484f-b2c9-c1898f5afe8e with: {'image_id': '8c1be9b3-f581-484f-b2c9-c1898f5afe8e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f83f431d3935213f9df201877a7917de', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83386) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd91f61-fd10-4496-8c70-648f7991f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad3d520-13ed-4309-843f-3a48e64635fe', 'volume_size': 1, 'image_id': '8c1be9b3-f581-484f-b2c9-c1898f5afe8e', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f83f431d3935213f9df201877a7917de', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7137199c4f674baf9e015a239f28e692', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4099a0a16593b35cb4357bd4af77649d9c729f9feb00dd59493a22dffeea519f1dc52392d066dd957ce2505e13514ad2470254575cef88167fe62e71bbc2be1', 'id': '8c1be9b3-f581-484f-b2c9-c1898f5afe8e', 'created_at': datetime.datetime(2025, 9, 16, 9, 45, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 9, 45, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c1be9b3-f581-484f-b2c9-c1898f5afe8e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8933c91e0>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec8114c-20ae-45ee-bbd8-da94bc968dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:02 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Volume volume-dad3d520-13ed-4309-843f-3a48e64635fe (dad3d520-13ed-4309-843f-3a48e64635fe): created successfully
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec8114c-20ae-45ee-bbd8-da94bc968dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Flow 'volume_create_manager' (95cb450a-34a9-4a6b-864c-81b155211515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:02 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8c69359e-df07-4230-9385-b2cdeccab27d tempest-VolumeImageDependencyTests-1668100056 None] Created volume successfully.
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Acquiring lock "cinder-dad3d520-13ed-4309-843f-3a48e64635fe-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Lock "cinder-dad3d520-13ed-4309-843f-3a48e64635fe-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:02 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Acquiring lock "cinder-quobyte-dad3d520-13ed-4309-843f-3a48e64635fe" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Lock "cinder-quobyte-dad3d520-13ed-4309-843f-3a48e64635fe" acquired by "delete_volume" :: waited 0.015s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:03 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada3a1de-f4bb-48bd-8429-94c26cf1e76d]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:46:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe" returned: 0 in 0.371s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe" returned: 1 in 0.392s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:46:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-dad3d520-13ed-4309-843f-3a48e64635fe" returned: 0 in 0.095s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Lock "cinder-quobyte-dad3d520-13ed-4309-843f-3a48e64635fe" released by "delete_volume" :: held 1.104s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Created reservations ['21d42ad3-d38d-4aa5-abd7-7f032446ad4f', '803f08d8-b1c3-4498-9840-bc1ba9cbeab2', '52126d94-4a99-4b47-aa9e-e63fdcd84052', 'ab9cb3f6-b8a2-448c-a839-b21c66da715c'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.091s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:46:04 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Deleted volume successfully.
Sep 16 11:46:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-a6e8ff76-ac48-42fc-b826-b1937f73679d tempest-VolumeImageDependencyTests-1668100056 None] Lock "cinder-dad3d520-13ed-4309-843f-3a48e64635fe-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:46:08 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Flow 'volume_create_manager' (d5e2b43e-2b62-4c1d-8006-f010005f2921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25184fe7-9bd5-4982-b7e1-0a3e10a27226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25184fe7-9bd5-4982-b7e1-0a3e10a27226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96af2ec6-0585-4965-8836-2f135a09917a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee82e686c445a9b597d426125a9125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:08Z,use_quota=True,user_id='d477611eda7a45dc90da5c3ac58e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12ceaac-b435-4b23-ac6e-81a112d08af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12ceaac-b435-4b23-ac6e-81a112d08af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c791202-6636-4356-a570-7c30a26b44e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c791202-6636-4356-a570-7c30a26b44e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96af2ec6-0585-4965-8836-2f135a09917a', 'volume_name': 'volume-96af2ec6-0585-4965-8836-2f135a09917a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba768aa3-6a97-49dc-a4be-5bff484b7b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba768aa3-6a97-49dc-a4be-5bff484b7b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70a5401-6f44-4772-97a8-014ba4c5b029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:08 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Volume 96af2ec6-0585-4965-8836-2f135a09917a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96af2ec6-0585-4965-8836-2f135a09917a', 'volume_size': 1}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96af2ec6-0585-4965-8836-2f135a09917a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee82e686c445a9b597d426125a9125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:08Z,use_quota=True,user_id='d477611eda7a45dc90da5c3ac58e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Creating volume 96af2ec6-0585-4965-8836-2f135a09917a {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:08 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-96af2ec6-0585-4965-8836-2f135a09917a 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:08 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=142, name=volume-96af2ec6-0585-4965-8836-2f135a09917a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-96af2ec6-0585-4965-8836-2f135a09917a 1073741824" returned: 0 in 0.336s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-96af2ec6-0585-4965-8836-2f135a09917a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-96af2ec6-0585-4965-8836-2f135a09917a" returned: 0 in 0.090s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:09 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] <== create_volume: return (495ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.508s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:09 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70a5401-6f44-4772-97a8-014ba4c5b029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96af2ec6-0585-4965-8836-2f135a09917a', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:09 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16aaa43-e73f-4029-9433-7bfc18724b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:09 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Volume volume-96af2ec6-0585-4965-8836-2f135a09917a (96af2ec6-0585-4965-8836-2f135a09917a): created successfully
Sep 16 11:46:09 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16aaa43-e73f-4029-9433-7bfc18724b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:09 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Flow 'volume_create_manager' (d5e2b43e-2b62-4c1d-8006-f010005f2921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:09 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-18df1c06-0275-4480-923a-05104fcad9b0 tempest-CinderUnicodeTest-881263331 None] Created volume successfully.
Sep 16 11:46:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Flow 'volume_create_manager' (f8712c93-2de2-475d-9576-1460054d7059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39b64fb-f345-4de0-bbea-6090a30a451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39b64fb-f345-4de0-bbea-6090a30a451c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2013245273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62296bf-8ed9-4f52-8677-78450cb1b58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee82e686c445a9b597d426125a9125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:11Z,use_quota=True,user_id='d477611eda7a45dc90da5c3ac58e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0b6fa2-7a36-4756-a0c3-5a34289101c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0b6fa2-7a36-4756-a0c3-5a34289101c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad88408-62a7-4b64-b08e-2a73eb794bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad88408-62a7-4b64-b08e-2a73eb794bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62296bf-8ed9-4f52-8677-78450cb1b58c', 'volume_name': 'volume-a62296bf-8ed9-4f52-8677-78450cb1b58c', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bc794c-5dce-4b93-bd35-b1ba7a052ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05bc794c-5dce-4b93-bd35-b1ba7a052ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09afd68-5b4f-4c9b-b5b9-3ecf60a5bbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:11 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Volume a62296bf-8ed9-4f52-8677-78450cb1b58c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62296bf-8ed9-4f52-8677-78450cb1b58c', 'volume_size': 1}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2013245273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62296bf-8ed9-4f52-8677-78450cb1b58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50ee82e686c445a9b597d426125a9125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:11Z,use_quota=True,user_id='d477611eda7a45dc90da5c3ac58e09ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Creating volume a62296bf-8ed9-4f52-8677-78450cb1b58c {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:11 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:11 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=143, name=volume-a62296bf-8ed9-4f52-8677-78450cb1b58c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c 1073741824" returned: 0 in 0.323s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c" returned: 0 in 0.087s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] <== create_volume: return (475ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.487s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09afd68-5b4f-4c9b-b5b9-3ecf60a5bbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62296bf-8ed9-4f52-8677-78450cb1b58c', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ca7d08-1b68-40ee-8c5d-bf714afcb736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:12 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Volume volume-a62296bf-8ed9-4f52-8677-78450cb1b58c (a62296bf-8ed9-4f52-8677-78450cb1b58c): created successfully
Sep 16 11:46:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ca7d08-1b68-40ee-8c5d-bf714afcb736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:12 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Flow 'volume_create_manager' (f8712c93-2de2-475d-9576-1460054d7059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:12 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-a1bec2f4-5d08-4e2d-adee-401e998304f1 tempest-CinderUnicodeTest-881263331 None] Created volume successfully.
Sep 16 11:46:13 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Creating offline snapshot cc536b3c-eafd-416e-a127-7ab3e85ac841 of volume a62296bf-8ed9-4f52-8677-78450cb1b58c {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:46:13 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c003c-7f7f-401e-a437-8bfd051aedb2]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:46:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c" returned: 0 in 0.405s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:14 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=144, name=volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841 1G" returned: 0 in 0.248s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a62296bf-8ed9-4f52-8677-78450cb1b58c -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] CMD "qemu-img rebase -u -b volume-a62296bf-8ed9-4f52-8677-78450cb1b58c -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841" returned: 0 in 0.147s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841" returned: 0 in 0.101s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841" returned: 0 in 0.115s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.info" returned: 0 in 0.108s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:46:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.info" returned: 0 in 0.089s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.574s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:15 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-1a355ed4-be21-4bcc-8ba5-7718e0c083fd tempest-CinderUnicodeTest-881263331 None] Create snapshot completed successfully
Sep 16 11:46:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Acquiring lock "cinder-cc536b3c-eafd-416e-a127-7ab3e85ac841-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Lock "cinder-cc536b3c-eafd-416e-a127-7ab3e85ac841-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Acquiring lock "cinder-quobyte-a62296bf-8ed9-4f52-8677-78450cb1b58c" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Lock "cinder-quobyte-a62296bf-8ed9-4f52-8677-78450cb1b58c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Acquiring lock "cinder-quobyte-cc536b3c-eafd-416e-a127-7ab3e85ac841" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Lock "cinder-quobyte-cc536b3c-eafd-416e-a127-7ab3e85ac841" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Deleting offline snapshot cc536b3c-eafd-416e-a127-7ab3e85ac841 of volume a62296bf-8ed9-4f52-8677-78450cb1b58c {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:46:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] snapshot_file for this snap is: volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:46:16 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec2ef25-03f2-4c11-922a-fa258a7d9ce5]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:46:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841" returned: 0 in 0.421s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a62296bf-8ed9-4f52-8677-78450cb1b58c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:46:16 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6842e0-f8a2-4cea-bf89-a9d05a8a36fd]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:46:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c" returned: 0 in 0.419s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841" returned: 0 in 0.190s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c.cc536b3c-eafd-416e-a127-7ab3e85ac841" returned: 0 in 0.100s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Lock "cinder-quobyte-cc536b3c-eafd-416e-a127-7ab3e85ac841" released by "_delete_snapshot" :: held 1.448s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:46:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Lock "cinder-quobyte-a62296bf-8ed9-4f52-8677-78450cb1b58c" released by "delete_snapshot" :: held 1.472s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:46:17 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Created reservations ['0b4caa4f-a136-4799-b65d-5bc68441cbfb', '326d94a6-9575-43c6-a72a-cad685f8e405', '0256232a-4220-415c-81f9-756e22945a6c', 'ca7f7ed3-baa8-4958-bbe7-657ddd94a533'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:46:17 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Delete snapshot completed successfully.
Sep 16 11:46:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ab7016-808f-40c2-b999-3c54f19f44a9 tempest-CinderUnicodeTest-881263331 None] Lock "cinder-cc536b3c-eafd-416e-a127-7ab3e85ac841-delete_snapshot" released by "delete_snapshot" :: held 1.969s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:46:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Acquiring lock "cinder-a62296bf-8ed9-4f52-8677-78450cb1b58c-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Lock "cinder-a62296bf-8ed9-4f52-8677-78450cb1b58c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Acquiring lock "cinder-quobyte-a62296bf-8ed9-4f52-8677-78450cb1b58c" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Lock "cinder-quobyte-a62296bf-8ed9-4f52-8677-78450cb1b58c" acquired by "delete_volume" :: waited 0.011s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:18 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cadf2a-7912-4516-bca1-50011bdea272]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:46:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c" returned: 0 in 0.418s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a62296bf-8ed9-4f52-8677-78450cb1b58c" returned: 0 in 0.121s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Lock "cinder-quobyte-a62296bf-8ed9-4f52-8677-78450cb1b58c" released by "delete_volume" :: held 0.720s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=53,cinder:UPDATE=76,cinder:DELETE=7,cinder:INSERT=17 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Created reservations ['c6992ef7-34e0-4048-a5d4-5956501176a8', '5c450748-c5f8-4bd7-98dc-27972ed0916a', 'f2706ed0-8dfb-4153-bfab-830d248cf033', '0cd401e7-7e3f-49d2-a77b-d85308109ba1'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.112s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:46:19 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Deleted volume successfully.
Sep 16 11:46:19 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d968313c-50a3-4488-8ab0-96279eae997b tempest-CinderUnicodeTest-881263331 None] Lock "cinder-a62296bf-8ed9-4f52-8677-78450cb1b58c-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:46:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Acquiring lock "cinder-96af2ec6-0585-4965-8836-2f135a09917a-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Lock "cinder-96af2ec6-0585-4965-8836-2f135a09917a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:20 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=55,cinder:UPDATE=75,cinder:DELETE=8,cinder:INSERT=23 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:46:20 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Acquiring lock "cinder-quobyte-96af2ec6-0585-4965-8836-2f135a09917a" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Lock "cinder-quobyte-96af2ec6-0585-4965-8836-2f135a09917a" acquired by "delete_volume" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:20 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[284ccbc7-a437-4455-b68f-29cf4f94fe1a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:46:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-96af2ec6-0585-4965-8836-2f135a09917a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-96af2ec6-0585-4965-8836-2f135a09917a" returned: 0 in 0.403s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-96af2ec6-0585-4965-8836-2f135a09917a {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-96af2ec6-0585-4965-8836-2f135a09917a" returned: 0 in 0.096s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Lock "cinder-quobyte-96af2ec6-0585-4965-8836-2f135a09917a" released by "delete_volume" :: held 0.667s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Created reservations ['bc38e2ff-116b-4604-b41b-6c44a823c3ee', 'bcb25707-4f4e-4815-bd0a-271b3ba14674', '49463a69-7c0e-4a25-ac3e-12b87a068275', '75bcd17a-51f9-4400-9013-f085d9c8d836'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.089s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:21 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:46:21 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Deleted volume successfully.
Sep 16 11:46:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-e68e7e91-2ac5-4473-8822-c4e7e8a805b2 tempest-CinderUnicodeTest-881263331 None] Lock "cinder-96af2ec6-0585-4965-8836-2f135a09917a-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:46:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:46:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.160s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:46:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:INSERT=5,cinder:UPDATE=16,cinder:SELECT=9,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:46:33 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:46:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Flow 'volume_create_manager' (334486ad-9720-4cf7-96d9-336fcff3953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285e9a16-c19b-4778-91f5-f6a0db23a335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285e9a16-c19b-4778-91f5-f6a0db23a335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-218508272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762b0df9-5ab1-469f-9019-73c77b1f26c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63aad2bd68449792ae6300051634ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:42Z,use_quota=True,user_id='7378f8ea1b9d4c20b0cdd9c8e2299dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a489ea-a129-4bbc-9533-e5abe91d3225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a489ea-a129-4bbc-9533-e5abe91d3225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fe1d1f-b2d5-489c-b0f1-90159008a275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fe1d1f-b2d5-489c-b0f1-90159008a275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762b0df9-5ab1-469f-9019-73c77b1f26c3', 'volume_name': 'volume-762b0df9-5ab1-469f-9019-73c77b1f26c3', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d2e31a-d109-4316-8e61-0b155c0f8af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d2e31a-d109-4316-8e61-0b155c0f8af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d65c58-2b10-4ea2-9cd4-402e20e88048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:42 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Volume 762b0df9-5ab1-469f-9019-73c77b1f26c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762b0df9-5ab1-469f-9019-73c77b1f26c3', 'volume_size': 1}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-218508272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762b0df9-5ab1-469f-9019-73c77b1f26c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63aad2bd68449792ae6300051634ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:42Z,use_quota=True,user_id='7378f8ea1b9d4c20b0cdd9c8e2299dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Creating volume 762b0df9-5ab1-469f-9019-73c77b1f26c3 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:42 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-762b0df9-5ab1-469f-9019-73c77b1f26c3 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:42 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=146, name=volume-762b0df9-5ab1-469f-9019-73c77b1f26c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (6290cbfe-05d8-40c2-b16e-5fc79014a426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7c1910-0caa-4b37-ba92-855a1417c327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7c1910-0caa-4b37-ba92-855a1417c327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-376730272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd4431d-45c6-402f-af2c-8ba8b5d79996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:42Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b70770-d920-4386-8350-d963cd91f1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b70770-d920-4386-8350-d963cd91f1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3a1b1e-947d-4615-a76b-85541b9a3b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3a1b1e-947d-4615-a76b-85541b9a3b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd4431d-45c6-402f-af2c-8ba8b5d79996', 'volume_name': 'volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddd06bb-264d-4d89-821c-4ef35463cd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dddd06bb-264d-4d89-821c-4ef35463cd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5198d11a-941e-4f2f-bddf-38d201e52088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:43 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume 7cd4431d-45c6-402f-af2c-8ba8b5d79996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996', 'volume_size': 1}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-762b0df9-5ab1-469f-9019-73c77b1f26c3 1073741824" returned: 0 in 0.930s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:43 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Flow 'volume_create_manager' (0eb5873e-3a4d-4ffe-a2e4-2729ae65c2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e42d481-2462-445d-9ab7-0e7b74e0b571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-762b0df9-5ab1-469f-9019-73c77b1f26c3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e42d481-2462-445d-9ab7-0e7b74e0b571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-55312453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6761954-ccc7-4fa2-8e21-d640613f9ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63aad2bd68449792ae6300051634ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:43Z,use_quota=True,user_id='7378f8ea1b9d4c20b0cdd9c8e2299dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5292f9f0-acca-4f41-947c-2a358203793b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5292f9f0-acca-4f41-947c-2a358203793b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4c6a53-58a9-4f11-9390-87088fb428f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4c6a53-58a9-4f11-9390-87088fb428f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6761954-ccc7-4fa2-8e21-d640613f9ab6', 'volume_name': 'volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5901a2-6967-4dca-bc4e-d2cbbf8aa086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5901a2-6967-4dca-bc4e-d2cbbf8aa086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (870e9f92-fd48-47a8-9832-8d592a096bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:43 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Volume d6761954-ccc7-4fa2-8e21-d640613f9ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6', 'volume_size': 1}
Sep 16 11:46:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-762b0df9-5ab1-469f-9019-73c77b1f26c3" returned: 0 in 0.715s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] <== create_volume: return (1800ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-376730272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd4431d-45c6-402f-af2c-8ba8b5d79996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:42Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Creating volume 7cd4431d-45c6-402f-af2c-8ba8b5d79996 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:44 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:44 devstack quobyte-client[83411]: System call of process 101272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:46:44 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=147, name=volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d65c58-2b10-4ea2-9cd4-402e20e88048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762b0df9-5ab1-469f-9019-73c77b1f26c3', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1436ce-e548-411c-9c1a-5304bdec5d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:44 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Flow 'volume_create_manager' (673ec6f2-e7fc-4bae-85e7-543e25ee9d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334e25ab-a5c5-4f39-9ea2-610e487d8122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:44 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Flow 'volume_create_manager' (401cb372-f679-4961-9957-b222e9afb7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c736feb7-0d11-42d0-aad7-5278f2e8ddcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c736feb7-0d11-42d0-aad7-5278f2e8ddcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1230366985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8abf24e-c6c0-4e47-a787-0e82dc55357b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63aad2bd68449792ae6300051634ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:44Z,use_quota=True,user_id='7378f8ea1b9d4c20b0cdd9c8e2299dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99cab8e-ad2c-4f56-b8bb-74d4bca3be21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99cab8e-ad2c-4f56-b8bb-74d4bca3be21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44afc615-56f2-481b-8f2d-e386f31d742d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44afc615-56f2-481b-8f2d-e386f31d742d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8abf24e-c6c0-4e47-a787-0e82dc55357b', 'volume_name': 'volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62897459-5d4f-41aa-a179-8fc5da9907f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62897459-5d4f-41aa-a179-8fc5da9907f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee44855-575b-406a-8569-d38297354963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Volume b8abf24e-c6c0-4e47-a787-0e82dc55357b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b', 'volume_size': 1}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:45 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Volume volume-762b0df9-5ab1-469f-9019-73c77b1f26c3 (762b0df9-5ab1-469f-9019-73c77b1f26c3): created successfully
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1436ce-e548-411c-9c1a-5304bdec5d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Flow 'volume_create_manager' (334486ad-9720-4cf7-96d9-336fcff3953c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:45 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Flow 'volume_create_manager' (6954ca87-d682-4d00-9662-d1a3f1ebefe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c5a57d-2ff8-4f26-9222-654f6f5bc8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334e25ab-a5c5-4f39-9ea2-610e487d8122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-73706356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a51470-f77e-4cbf-9233-828b9e612346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63aad2bd68449792ae6300051634ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:43Z,use_quota=True,user_id='7378f8ea1b9d4c20b0cdd9c8e2299dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a23d6f-2bae-4951-90cf-794236e41d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a23d6f-2bae-4951-90cf-794236e41d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0d3128-5b7a-40ac-adeb-86d3a83ab223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0d3128-5b7a-40ac-adeb-86d3a83ab223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48a51470-f77e-4cbf-9233-828b9e612346', 'volume_name': 'volume-48a51470-f77e-4cbf-9233-828b9e612346', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153f143a-7ee6-4c5c-8c08-62cefd03837b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153f143a-7ee6-4c5c-8c08-62cefd03837b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41df5370-e12a-44cc-8785-aae13ff40c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Volume 48a51470-f77e-4cbf-9233-828b9e612346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48a51470-f77e-4cbf-9233-828b9e612346', 'volume_size': 1}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996 1073741824" returned: 0 in 0.977s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:45 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-b185c9db-37a7-4cab-aaf4-8f27512335f1 tempest-CreateVolumesFromImageTest-243083448 None] Created volume successfully.
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c5a57d-2ff8-4f26-9222-654f6f5bc8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-427523941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1744457-bb54-4b16-9fd7-edf47d8dd518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63aad2bd68449792ae6300051634ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:45Z,use_quota=True,user_id='7378f8ea1b9d4c20b0cdd9c8e2299dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8be6ae-5457-441b-b373-510bd4221209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8be6ae-5457-441b-b373-510bd4221209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028408df-facb-4b1f-a7e9-02801926a378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028408df-facb-4b1f-a7e9-02801926a378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1744457-bb54-4b16-9fd7-edf47d8dd518', 'volume_name': 'volume-e1744457-bb54-4b16-9fd7-edf47d8dd518', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c511f159-d3a4-4f17-b442-e688ab84e3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c511f159-d3a4-4f17-b442-e688ab84e3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a999a6-eb44-4e50-bada-9bf394408692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:45 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Volume e1744457-bb54-4b16-9fd7-edf47d8dd518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1744457-bb54-4b16-9fd7-edf47d8dd518', 'volume_size': 1}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996" returned: 0 in 0.538s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] <== create_volume: return (1538ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.876s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-55312453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6761954-ccc7-4fa2-8e21-d640613f9ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63aad2bd68449792ae6300051634ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:43Z,use_quota=True,user_id='7378f8ea1b9d4c20b0cdd9c8e2299dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Creating volume d6761954-ccc7-4fa2-8e21-d640613f9ab6 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:45 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:46 devstack quobyte-client[83411]: System call of process 101276 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:46:46 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=148, name=volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5198d11a-941e-4f2f-bddf-38d201e52088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4764a348-5ae6-4f6e-941f-3aa99c76ac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:46 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996 (7cd4431d-45c6-402f-af2c-8ba8b5d79996): created successfully
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4764a348-5ae6-4f6e-941f-3aa99c76ac73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (6290cbfe-05d8-40c2-b16e-5fc79014a426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6 1073741824" returned: 0 in 0.529s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:46 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-b218a993-f378-49b3-98e4-6732719fae4f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created volume successfully.
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6" returned: 0 in 0.273s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] <== create_volume: return (833ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1230366985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8abf24e-c6c0-4e47-a787-0e82dc55357b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63aad2bd68449792ae6300051634ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:44Z,use_quota=True,user_id='7378f8ea1b9d4c20b0cdd9c8e2299dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Creating volume b8abf24e-c6c0-4e47-a787-0e82dc55357b {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:46 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:46 devstack quobyte-client[83411]: System call of process 101281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:46:46 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=149, name=volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (870e9f92-fd48-47a8-9832-8d592a096bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2998eeb6-9288-4303-8c30-79c85bbe56da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:47 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Volume volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6 (d6761954-ccc7-4fa2-8e21-d640613f9ab6): created successfully
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2998eeb6-9288-4303-8c30-79c85bbe56da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Flow 'volume_create_manager' (0eb5873e-3a4d-4ffe-a2e4-2729ae65c2ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b 1073741824" returned: 0 in 0.566s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b" returned: 0 in 0.154s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] <== create_volume: return (774ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.346s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-73706356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48a51470-f77e-4cbf-9233-828b9e612346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63aad2bd68449792ae6300051634ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:43Z,use_quota=True,user_id='7378f8ea1b9d4c20b0cdd9c8e2299dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Creating volume 48a51470-f77e-4cbf-9233-828b9e612346 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:47 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-48a51470-f77e-4cbf-9233-828b9e612346 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee44855-575b-406a-8569-d38297354963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:47 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfeb1add-e7d6-4b89-98d4-1fd3565ba228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:47 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=150, name=volume-48a51470-f77e-4cbf-9233-828b9e612346, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:48 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-74bd372f-99ce-49ee-8979-3341426ec087 tempest-CreateVolumesFromImageTest-243083448 None] Created volume successfully.
Sep 16 11:46:48 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Volume volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b (b8abf24e-c6c0-4e47-a787-0e82dc55357b): created successfully
Sep 16 11:46:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfeb1add-e7d6-4b89-98d4-1fd3565ba228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Flow 'volume_create_manager' (401cb372-f679-4961-9957-b222e9afb7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-48a51470-f77e-4cbf-9233-828b9e612346 1073741824" returned: 0 in 0.719s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-48a51470-f77e-4cbf-9233-828b9e612346 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:48 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-da4b853d-9633-49d8-8d3d-3419c6665ca1 tempest-CreateVolumesFromImageTest-243083448 None] Created volume successfully.
Sep 16 11:46:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-48a51470-f77e-4cbf-9233-828b9e612346" returned: 0 in 0.660s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] <== create_volume: return (1450ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.336s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-427523941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1744457-bb54-4b16-9fd7-edf47d8dd518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af63aad2bd68449792ae6300051634ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:45Z,use_quota=True,user_id='7378f8ea1b9d4c20b0cdd9c8e2299dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Creating volume e1744457-bb54-4b16-9fd7-edf47d8dd518 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:49 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e1744457-bb54-4b16-9fd7-edf47d8dd518 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:49 devstack quobyte-client[83411]: System call of process 101291 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:46:49 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=151, name=volume-e1744457-bb54-4b16-9fd7-edf47d8dd518, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41df5370-e12a-44cc-8785-aae13ff40c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48a51470-f77e-4cbf-9233-828b9e612346', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40462e66-64cd-4490-bfe4-55b0eda604bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:49 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (00c7771c-02d2-474f-9587-4799bd0b8028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedc2361-875b-479b-ba68-4afb3d9a2b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:50 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (9bf1238c-a8f2-4836-b15a-758b2be60b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fc56c1-baa1-4151-be54-22a146ea0335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:50 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Volume volume-48a51470-f77e-4cbf-9233-828b9e612346 (48a51470-f77e-4cbf-9233-828b9e612346): created successfully
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40462e66-64cd-4490-bfe4-55b0eda604bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Flow 'volume_create_manager' (673ec6f2-e7fc-4bae-85e7-543e25ee9d6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedc2361-875b-479b-ba68-4afb3d9a2b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1674413053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1a1f85-9ca4-4c62-b765-6331a3c219dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:49Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1afe56-9453-4715-a133-9263e72e416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a1afe56-9453-4715-a133-9263e72e416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fd436c-38a7-47a6-ad5e-af85d13c50b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fd436c-38a7-47a6-ad5e-af85d13c50b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1a1f85-9ca4-4c62-b765-6331a3c219dc', 'volume_name': 'volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf53a16-98d6-4ff0-b142-90eb1cba22fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf53a16-98d6-4ff0-b142-90eb1cba22fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3def99de-871e-4d7a-ad59-3e777a286caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:50 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume fa1a1f85-9ca4-4c62-b765-6331a3c219dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc', 'volume_size': 1}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:50 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (c69a0648-4999-4e8f-8c51-7b6a19fb1e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a21b99-52ff-4b2d-8657-09139c14bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e1744457-bb54-4b16-9fd7-edf47d8dd518 1073741824" returned: 0 in 1.138s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e1744457-bb54-4b16-9fd7-edf47d8dd518 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:51 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-b3851017-27a3-4980-a1c0-a401b298b023 tempest-CreateVolumesFromImageTest-243083448 None] Created volume successfully.
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39fc56c1-baa1-4151-be54-22a146ea0335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1475879976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23be0e6-45fc-4241-b020-dbebf0082206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:49Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0682eac9-0e33-415e-a7d2-8ca8fc32ea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0682eac9-0e33-415e-a7d2-8ca8fc32ea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e5021b-967a-4192-b00c-0d95d25902ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e5021b-967a-4192-b00c-0d95d25902ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23be0e6-45fc-4241-b020-dbebf0082206', 'volume_name': 'volume-b23be0e6-45fc-4241-b020-dbebf0082206', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800b529f-f51e-4500-ade2-4e8cf1a1a448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800b529f-f51e-4500-ade2-4e8cf1a1a448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfc37b4-3a44-4618-b30a-51835534fdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume b23be0e6-45fc-4241-b020-dbebf0082206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23be0e6-45fc-4241-b020-dbebf0082206', 'volume_size': 1}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a21b99-52ff-4b2d-8657-09139c14bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776624592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97dabcc-862b-4645-b201-96da167a0683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:50Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e357f8-204e-418d-bac6-33c1ee47dc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e357f8-204e-418d-bac6-33c1ee47dc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163e04d1-9f88-44ca-90f4-0fca602ecefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163e04d1-9f88-44ca-90f4-0fca602ecefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a97dabcc-862b-4645-b201-96da167a0683', 'volume_name': 'volume-a97dabcc-862b-4645-b201-96da167a0683', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b521b690-1bd3-4392-990d-ea5308f68f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b521b690-1bd3-4392-990d-ea5308f68f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4062d3d8-8e33-4b32-8561-04a9d1c77d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume a97dabcc-862b-4645-b201-96da167a0683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a97dabcc-862b-4645-b201-96da167a0683', 'volume_size': 1}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (56b83c08-b116-4cc0-93b4-815f52645b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e78244-9ce1-401c-840e-23c99a40de18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (5d0ce04b-a4bf-4a4c-bb3a-273ea91bf30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984072a1-f866-439a-bc6f-bae383c6da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e1744457-bb54-4b16-9fd7-edf47d8dd518" returned: 0 in 1.387s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e78244-9ce1-401c-840e-23c99a40de18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601189588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c4d55d-7aa3-4fd4-a549-492a36984077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:51Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a98e5cd-0b22-45c1-b3c0-bd9b2b5aaeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a98e5cd-0b22-45c1-b3c0-bd9b2b5aaeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00656b67-1502-4761-9932-3da578be7111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00656b67-1502-4761-9932-3da578be7111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c4d55d-7aa3-4fd4-a549-492a36984077', 'volume_name': 'volume-b4c4d55d-7aa3-4fd4-a549-492a36984077', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99c66f1-7c81-4072-95cf-74c4d7e6cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99c66f1-7c81-4072-95cf-74c4d7e6cad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd5d408-60c3-4011-88a2-2201cdbf931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:51 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume b4c4d55d-7aa3-4fd4-a549-492a36984077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c4d55d-7aa3-4fd4-a549-492a36984077', 'volume_size': 1}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] <== create_volume: return (2601ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.617s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1674413053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1a1f85-9ca4-4c62-b765-6331a3c219dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:49Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Creating volume fa1a1f85-9ca4-4c62-b765-6331a3c219dc {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:51 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:52 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=152, name=volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984072a1-f866-439a-bc6f-bae383c6da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-172653734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7744249-09ea-4e64-b2ce-b7551e2b8df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:50Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3835cc82-cb9d-45f6-80cd-c054f20df220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3835cc82-cb9d-45f6-80cd-c054f20df220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb707cb2-5978-4c22-b50a-2a48c9241a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb707cb2-5978-4c22-b50a-2a48c9241a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7744249-09ea-4e64-b2ce-b7551e2b8df3', 'volume_name': 'volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf52fa9-7e8f-48e4-a582-0b9d9a7bb428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf52fa9-7e8f-48e4-a582-0b9d9a7bb428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067955c3-24fa-4a03-aedd-5786a9f833a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:52 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume e7744249-09ea-4e64-b2ce-b7551e2b8df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3', 'volume_size': 1}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a999a6-eb44-4e50-bada-9bf394408692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1744457-bb54-4b16-9fd7-edf47d8dd518', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39387590-e2ba-4d40-871f-549aa39b72ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc 1073741824" returned: 0 in 0.780s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:52 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Volume volume-e1744457-bb54-4b16-9fd7-edf47d8dd518 (e1744457-bb54-4b16-9fd7-edf47d8dd518): created successfully
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39387590-e2ba-4d40-871f-549aa39b72ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Flow 'volume_create_manager' (6954ca87-d682-4d00-9662-d1a3f1ebefe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc" returned: 0 in 0.473s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] <== create_volume: return (1285ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.715s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1475879976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23be0e6-45fc-4241-b020-dbebf0082206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:49Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Creating volume b23be0e6-45fc-4241-b020-dbebf0082206 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:53 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:53 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b23be0e6-45fc-4241-b020-dbebf0082206 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:53 devstack quobyte-client[83411]: System call of process 101301 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:46:53 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=153, name=volume-b23be0e6-45fc-4241-b020-dbebf0082206, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:53 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5b6e8746-9f5d-4faf-ae44-4acb03e65280 tempest-CreateVolumesFromImageTest-243083448 None] Created volume successfully.
Sep 16 11:46:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "cinder-e1744457-bb54-4b16-9fd7-edf47d8dd518-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3def99de-871e-4d7a-ad59-3e777a286caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:54 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f7f6b8-d8a7-43ae-9b0d-e7f3e3c1fe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b23be0e6-45fc-4241-b020-dbebf0082206 1073741824" returned: 0 in 1.184s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b23be0e6-45fc-4241-b020-dbebf0082206 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-e1744457-bb54-4b16-9fd7-edf47d8dd518-delete_volume" acquired by "delete_volume" :: waited 0.356s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:54 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc (fa1a1f85-9ca4-4c62-b765-6331a3c219dc): created successfully
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f7f6b8-d8a7-43ae-9b0d-e7f3e3c1fe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (00c7771c-02d2-474f-9587-4799bd0b8028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b23be0e6-45fc-4241-b020-dbebf0082206" returned: 0 in 0.673s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] <== create_volume: return (2001ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.685s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776624592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97dabcc-862b-4645-b201-96da167a0683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:50Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Creating volume a97dabcc-862b-4645-b201-96da167a0683 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:55 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a97dabcc-862b-4645-b201-96da167a0683 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:55 devstack quobyte-client[83411]: System call of process 101305 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:46:55 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=154, name=volume-a97dabcc-862b-4645-b201-96da167a0683, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:55 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-12f7a3d2-cd00-4019-b422-502dfa461f3f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created volume successfully.
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfc37b4-3a44-4618-b30a-51835534fdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23be0e6-45fc-4241-b020-dbebf0082206', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:55 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e2fcb3-836a-4935-aee9-a159f8d319ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:56 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "cinder-quobyte-e1744457-bb54-4b16-9fd7-edf47d8dd518" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:46:56 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume volume-b23be0e6-45fc-4241-b020-dbebf0082206 (b23be0e6-45fc-4241-b020-dbebf0082206): created successfully
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e2fcb3-836a-4935-aee9-a159f8d319ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (9bf1238c-a8f2-4836-b15a-758b2be60b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a97dabcc-862b-4645-b201-96da167a0683 1073741824" returned: 0 in 0.950s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a97dabcc-862b-4645-b201-96da167a0683 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:56 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-7e36b7c3-e89c-4ea2-b41b-b3cffade4726 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created volume successfully.
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a97dabcc-862b-4645-b201-96da167a0683" returned: 0 in 0.339s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] <== create_volume: return (1314ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-quobyte-e1744457-bb54-4b16-9fd7-edf47d8dd518" acquired by "delete_volume" :: waited 0.421s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.835s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601189588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c4d55d-7aa3-4fd4-a549-492a36984077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:51Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Creating volume b4c4d55d-7aa3-4fd4-a549-492a36984077 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:56 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4c4d55d-7aa3-4fd4-a549-492a36984077 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cf439d-4ce9-4e60-978a-bda54955772a]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:46:56 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=155, name=volume-b4c4d55d-7aa3-4fd4-a549-492a36984077, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e1744457-bb54-4b16-9fd7-edf47d8dd518 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4062d3d8-8e33-4b32-8561-04a9d1c77d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97dabcc-862b-4645-b201-96da167a0683', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd957f87-1b98-4b58-87a0-df0050312c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4c4d55d-7aa3-4fd4-a549-492a36984077 1073741824" returned: 0 in 0.991s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4c4d55d-7aa3-4fd4-a549-492a36984077 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:57 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume volume-a97dabcc-862b-4645-b201-96da167a0683 (a97dabcc-862b-4645-b201-96da167a0683): created successfully
Sep 16 11:46:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd957f87-1b98-4b58-87a0-df0050312c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:57 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (c69a0648-4999-4e8f-8c51-7b6a19fb1e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:57 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e17210b7-3d76-4f30-bed0-7e65aa16aa99 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created volume successfully.
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4c4d55d-7aa3-4fd4-a549-492a36984077" returned: 0 in 0.449s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e1744457-bb54-4b16-9fd7-edf47d8dd518" returned: 0 in 1.136s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] <== create_volume: return (1474ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e1744457-bb54-4b16-9fd7-edf47d8dd518 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.922s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-172653734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7744249-09ea-4e64-b2ce-b7551e2b8df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e3022bdc3243dc939afd122a4c2f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:46:50Z,use_quota=True,user_id='974eedf5f0f6490e85b29ab830b1836c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Creating volume e7744249-09ea-4e64-b2ce-b7551e2b8df3 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:46:58 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:58 devstack quobyte-client[83411]: System call of process 101317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:46:58 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=156, name=volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd5d408-60c3-4011-88a2-2201cdbf931d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c4d55d-7aa3-4fd4-a549-492a36984077', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faced810-d45f-44aa-a36c-bede0cb3285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:58 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume volume-b4c4d55d-7aa3-4fd4-a549-492a36984077 (b4c4d55d-7aa3-4fd4-a549-492a36984077): created successfully
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faced810-d45f-44aa-a36c-bede0cb3285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (56b83c08-b116-4cc0-93b4-815f52645b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e1744457-bb54-4b16-9fd7-edf47d8dd518" returned: 0 in 0.843s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3 1073741824" returned: 0 in 0.630s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:58 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-e62e3fc6-8154-4d94-99f9-5a268ae42f64 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created volume successfully.
Sep 16 11:46:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-quobyte-e1744457-bb54-4b16-9fd7-edf47d8dd518" released by "delete_volume" :: held 2.624s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3" returned: 0 in 0.427s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] <== create_volume: return (1136ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067955c3-24fa-4a03-aedd-5786a9f833a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd87de7d-fdeb-484d-8230-800e92f7d3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:46:59 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3 (e7744249-09ea-4e64-b2ce-b7551e2b8df3): created successfully
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd87de7d-fdeb-484d-8230-800e92f7d3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Flow 'volume_create_manager' (5d0ce04b-a4bf-4a4c-bb3a-273ea91bf30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Created reservations ['63d954de-5533-427a-bf3f-806c1f342c39', '2608b7b8-8831-429e-8c33-316f60512ee0', 'b3cd4365-abe9-410b-b355-b3df141054ff', '924fd113-bafc-47bc-adb1-77874ece424a'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:46:59 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-db8fd0d3-8800-4fa8-88d7-f25f676f0a40 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created volume successfully.
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:46:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.104s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:00 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:00 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Deleted volume successfully.
Sep 16 11:47:00 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-404217fa-2e22-4010-9781-b857842ce87e tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-e1744457-bb54-4b16-9fd7-edf47d8dd518-delete_volume" released by "delete_volume" :: held 5.727s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:00 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "cinder-b8abf24e-c6c0-4e47-a787-0e82dc55357b-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:00 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-b8abf24e-c6c0-4e47-a787-0e82dc55357b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:00 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-b4c4d55d-7aa3-4fd4-a549-492a36984077-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:01 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "cinder-quobyte-b8abf24e-c6c0-4e47-a787-0e82dc55357b" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-b4c4d55d-7aa3-4fd4-a549-492a36984077-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-quobyte-b8abf24e-c6c0-4e47-a787-0e82dc55357b" acquired by "delete_volume" :: waited 0.042s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[26622e27-31a7-4b53-8bc7-1daf02cf7f75]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:01 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-quobyte-b4c4d55d-7aa3-4fd4-a549-492a36984077" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-b4c4d55d-7aa3-4fd4-a549-492a36984077" acquired by "delete_volume" :: waited 0.066s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e4335f-fb0f-4982-a7ff-3863f491a703]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4c4d55d-7aa3-4fd4-a549-492a36984077 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b" returned: 0 in 0.799s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b8abf24e-c6c0-4e47-a787-0e82dc55357b" returned: 0 in 0.195s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-quobyte-b8abf24e-c6c0-4e47-a787-0e82dc55357b" released by "delete_volume" :: held 1.285s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4c4d55d-7aa3-4fd4-a549-492a36984077" returned: 0 in 0.884s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4c4d55d-7aa3-4fd4-a549-492a36984077 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b4c4d55d-7aa3-4fd4-a549-492a36984077" returned: 0 in 0.268s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-b4c4d55d-7aa3-4fd4-a549-492a36984077" released by "delete_volume" :: held 1.363s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Created reservations ['1c3bc7ec-ae9c-4619-90f5-c48cac6dfaaa', '609433f3-6da8-447d-826d-14548530a63c', 'aac8ace4-bfb0-47ec-b153-c98ebb83a90a', 'aba1a89b-57a5-4e96-80ce-bd535cc78a8f'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created reservations ['d4a4de26-e081-437c-81ac-c852d7db326b', '44bc5291-7b78-4833-a69e-acc6bf1be0e3', '3f83e9a0-790a-49f0-a3d6-76f55e4dfb00', 'fe9bc8e8-698a-4842-afc7-9bd419db8d92'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.411s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:03 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Deleted volume successfully.
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-82d6366e-f13b-4412-b791-de872452354c tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-b8abf24e-c6c0-4e47-a787-0e82dc55357b-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.313s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:04 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Deleted volume successfully.
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "cinder-48a51470-f77e-4cbf-9233-828b9e612346-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-e7744249-09ea-4e64-b2ce-b7551e2b8df3-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-48a51470-f77e-4cbf-9233-828b9e612346-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-e7744249-09ea-4e64-b2ce-b7551e2b8df3-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5482a9b2-b794-4793-a289-2f2907bc5b6b tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-b4c4d55d-7aa3-4fd4-a549-492a36984077-delete_volume" released by "delete_volume" :: held 3.642s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:04 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-quobyte-e7744249-09ea-4e64-b2ce-b7551e2b8df3" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:04 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "cinder-quobyte-48a51470-f77e-4cbf-9233-828b9e612346" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-e7744249-09ea-4e64-b2ce-b7551e2b8df3" acquired by "delete_volume" :: waited 0.059s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[4824ea3f-af34-434d-8d47-36809ad1635b]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-quobyte-48a51470-f77e-4cbf-9233-828b9e612346" acquired by "delete_volume" :: waited 0.168s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:05 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef68a76e-abeb-4d6d-ae39-21d35c35b956]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-48a51470-f77e-4cbf-9233-828b9e612346 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3" returned: 0 in 0.748s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:05 devstack quobyte-client[83411]: System call of process 101340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:47:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-48a51470-f77e-4cbf-9233-828b9e612346" returned: 0 in 0.743s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-48a51470-f77e-4cbf-9233-828b9e612346 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-e7744249-09ea-4e64-b2ce-b7551e2b8df3" returned: 0 in 0.361s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-48a51470-f77e-4cbf-9233-828b9e612346" returned: 0 in 0.238s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-e7744249-09ea-4e64-b2ce-b7551e2b8df3" released by "delete_volume" :: held 1.381s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-quobyte-48a51470-f77e-4cbf-9233-828b9e612346" released by "delete_volume" :: held 1.317s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Created reservations ['849b301b-cb74-4636-9a2d-97faa95790df', '0ffa36e7-7ea9-411b-968e-0e107c0579e9', '46f06663-a906-4c4b-bce2-6aec3596564d', '751e1f07-56f9-414c-820c-dc4d8f7a1401'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created reservations ['1516e57d-c5d4-4ad5-8093-afb779671694', '0d22de29-5ec5-49a3-9073-e3c53b275510', '666c1785-84fa-46b6-8f53-b34308dfb425', 'd84ca930-20aa-455e-906f-75a536d094b1'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.227s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-a97dabcc-862b-4645-b201-96da167a0683-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:07 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Deleted volume successfully.
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-a97dabcc-862b-4645-b201-96da167a0683-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-15ca8959-57c0-4890-92e1-d4adcc2f9c79 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-e7744249-09ea-4e64-b2ce-b7551e2b8df3-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.582s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:07 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:07 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Deleted volume successfully.
Sep 16 11:47:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "cinder-d6761954-ccc7-4fa2-8e21-d640613f9ab6-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:08 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-quobyte-a97dabcc-862b-4645-b201-96da167a0683" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1329d106-fbd8-436c-b384-a63d03672767 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-48a51470-f77e-4cbf-9233-828b9e612346-delete_volume" released by "delete_volume" :: held 3.691s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-d6761954-ccc7-4fa2-8e21-d640613f9ab6-delete_volume" acquired by "delete_volume" :: waited 0.186s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-a97dabcc-862b-4645-b201-96da167a0683" acquired by "delete_volume" :: waited 0.063s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:08 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[6702b9a9-690e-4497-8b0c-b96f10f065f6]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a97dabcc-862b-4645-b201-96da167a0683 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:08 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "cinder-quobyte-d6761954-ccc7-4fa2-8e21-d640613f9ab6" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-quobyte-d6761954-ccc7-4fa2-8e21-d640613f9ab6" acquired by "delete_volume" :: waited 0.116s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a97dabcc-862b-4645-b201-96da167a0683" returned: 0 in 0.724s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a97dabcc-862b-4645-b201-96da167a0683 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:09 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[20183994-bbca-4bcc-829d-e4b1f8adc187]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-a97dabcc-862b-4645-b201-96da167a0683" returned: 0 in 0.326s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:09 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-a97dabcc-862b-4645-b201-96da167a0683" released by "delete_volume" :: held 1.271s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:09 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created reservations ['2bb61ed2-73c3-4b4d-8122-5216365ccf19', '40cbd09a-14a4-4689-be7b-493af6018e76', '5541537b-94f8-4520-8b2e-25b14c5d5d2f', 'bc899251-de58-45f8-83b8-c923b3f94599'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6" returned: 0 in 0.843s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:10 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-b23be0e6-45fc-4241-b020-dbebf0082206-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d6761954-ccc7-4fa2-8e21-d640613f9ab6" returned: 0 in 0.795s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-quobyte-d6761954-ccc7-4fa2-8e21-d640613f9ab6" released by "delete_volume" :: held 1.994s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.568s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:11 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-b23be0e6-45fc-4241-b020-dbebf0082206-delete_volume" acquired by "delete_volume" :: waited 0.346s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:11 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Deleted volume successfully.
Sep 16 11:47:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-quobyte-b23be0e6-45fc-4241-b020-dbebf0082206" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-620b449c-7690-4aab-ad9b-136b4e91cf5f tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-a97dabcc-862b-4645-b201-96da167a0683-delete_volume" released by "delete_volume" :: held 4.417s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:11 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Created reservations ['57620549-c35a-47fe-a7e8-c61885751240', '245ea8dc-986c-42ab-8489-6f99c9c78b92', '644d7a91-0ee7-4697-9eab-c844bd33ad3e', '402dffe9-18aa-45c9-888d-7ec69ab90eb3'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-b23be0e6-45fc-4241-b020-dbebf0082206" acquired by "delete_volume" :: waited 0.097s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:11 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[663c6b7e-02c8-4dfd-8f01-68cfdb843783]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b23be0e6-45fc-4241-b020-dbebf0082206 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b23be0e6-45fc-4241-b020-dbebf0082206" returned: 0 in 0.939s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b23be0e6-45fc-4241-b020-dbebf0082206 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "cinder-762b0df9-5ab1-469f-9019-73c77b1f26c3-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-b23be0e6-45fc-4241-b020-dbebf0082206" returned: 0 in 0.478s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-762b0df9-5ab1-469f-9019-73c77b1f26c3-delete_volume" acquired by "delete_volume" :: waited 0.145s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-b23be0e6-45fc-4241-b020-dbebf0082206" released by "delete_volume" :: held 1.865s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.505s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:14 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Deleted volume successfully.
Sep 16 11:47:14 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "cinder-quobyte-762b0df9-5ab1-469f-9019-73c77b1f26c3" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-38ce1595-4477-48af-b403-16860c1cb732 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-d6761954-ccc7-4fa2-8e21-d640613f9ab6-delete_volume" released by "delete_volume" :: held 5.935s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:14 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created reservations ['ccc7f5f7-916c-44c8-8557-19eb701fa31b', '2435f6e4-7236-4764-8515-238fd06b7a31', 'caf303a1-15fe-4e49-b83e-3d1638c4e914', '2e20c9e7-dba1-4545-93fe-2db0fd22f93f'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-quobyte-762b0df9-5ab1-469f-9019-73c77b1f26c3" acquired by "delete_volume" :: waited 0.068s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:14 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[badac20f-bf82-42b4-9cbd-f21dec486a56]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-762b0df9-5ab1-469f-9019-73c77b1f26c3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-762b0df9-5ab1-469f-9019-73c77b1f26c3" returned: 0 in 0.987s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-762b0df9-5ab1-469f-9019-73c77b1f26c3 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-fa1a1f85-9ca4-4c62-b765-6331a3c219dc-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.813s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:15 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-762b0df9-5ab1-469f-9019-73c77b1f26c3" returned: 0 in 0.626s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:16 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Deleted volume successfully.
Sep 16 11:47:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-fa1a1f85-9ca4-4c62-b765-6331a3c219dc-delete_volume" acquired by "delete_volume" :: waited 0.357s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-quobyte-762b0df9-5ab1-469f-9019-73c77b1f26c3" released by "delete_volume" :: held 1.945s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-dd900846-6ed4-4656-986b-e461adae9eed tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-b23be0e6-45fc-4241-b020-dbebf0082206-delete_volume" released by "delete_volume" :: held 5.007s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:16 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-quobyte-fa1a1f85-9ca4-4c62-b765-6331a3c219dc" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:16 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-fa1a1f85-9ca4-4c62-b765-6331a3c219dc" acquired by "delete_volume" :: waited 0.031s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:16 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fe71d7-c567-45e4-a26b-1a61b2bd69a6]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:16 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Created reservations ['0529127a-58c8-44ee-9011-f256d8cf156b', '2f59c8ff-1f30-4230-80bb-32f6f0c25160', 'ebd5a43f-4682-4fa3-8869-df84357c7b50', 'ee4826a3-fa77-4050-a5b3-4f7ca858aca8'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc" returned: 0 in 0.812s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.242s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:17 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Deleted volume successfully.
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-fa1a1f85-9ca4-4c62-b765-6331a3c219dc" returned: 0 in 0.421s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-fa1a1f85-9ca4-4c62-b765-6331a3c219dc" released by "delete_volume" :: held 1.488s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ece9fd34-843e-449b-afe8-cb7a70bfe4d5 tempest-CreateVolumesFromImageTest-243083448 None] Lock "cinder-762b0df9-5ab1-469f-9019-73c77b1f26c3-delete_volume" released by "delete_volume" :: held 4.548s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Flow 'volume_create_manager' (84d2e260-26ce-466a-ade1-a9a6a0852754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9fb993-cdd9-449f-8e90-1f2f4e6488ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9fb993-cdd9-449f-8e90-1f2f4e6488ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-172176877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83ac43c-a5de-45d9-b7b3-80058312a445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bf2b6ab0b142588cfbe9916dab0c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:17Z,use_quota=True,user_id='acf354106aee4872a7c1a658bf95f3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2f0202-691e-4bd6-829e-f0398582e11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2f0202-691e-4bd6-829e-f0398582e11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9e3ecc-ff3f-4bb5-989e-6709ddfc2ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9e3ecc-ff3f-4bb5-989e-6709ddfc2ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83ac43c-a5de-45d9-b7b3-80058312a445', 'volume_name': 'volume-c83ac43c-a5de-45d9-b7b3-80058312a445', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab2e8d5-af93-471f-b3db-464899230fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ab2e8d5-af93-471f-b3db-464899230fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d2cb9d-8d85-4a11-98fa-7cc2a5aabaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:18 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Volume c83ac43c-a5de-45d9-b7b3-80058312a445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83ac43c-a5de-45d9-b7b3-80058312a445', 'volume_size': 1}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-172176877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83ac43c-a5de-45d9-b7b3-80058312a445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bf2b6ab0b142588cfbe9916dab0c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:17Z,use_quota=True,user_id='acf354106aee4872a7c1a658bf95f3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Creating volume c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:47:18 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:18 devstack quobyte-client[83411]: System call of process 101408 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:47:18 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=157, name=volume-c83ac43c-a5de-45d9-b7b3-80058312a445, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 1073741824" returned: 0 in 0.491s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:18 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created reservations ['aa47e646-5248-443b-b81c-dbb6fb287bdc', 'd4ab08a1-65d6-4c6e-a58f-e711167b7f97', '5281f288-d5a2-4b36-bc90-8494e22e02f4', 'a255ae59-f5ff-460f-bd71-32b22ed2ec62'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445" returned: 0 in 0.325s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] <== create_volume: return (871ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d2cb9d-8d85-4a11-98fa-7cc2a5aabaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83ac43c-a5de-45d9-b7b3-80058312a445', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45395b2-6fa9-4e44-a634-83c11bef3430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:19 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Volume volume-c83ac43c-a5de-45d9-b7b3-80058312a445 (c83ac43c-a5de-45d9-b7b3-80058312a445): created successfully
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45395b2-6fa9-4e44-a634-83c11bef3430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Flow 'volume_create_manager' (84d2e260-26ce-466a-ade1-a9a6a0852754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:19 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-c591603a-da95-4f7d-a363-2eec0068b69a tempest-SnapshotDependencyTests-1274203991 None] Created volume successfully.
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.183s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:19 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Deleted volume successfully.
Sep 16 11:47:19 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-476fbef2-fcd4-4ef0-9b83-a04f22fbf84d tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-fa1a1f85-9ca4-4c62-b765-6331a3c219dc-delete_volume" released by "delete_volume" :: held 3.751s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-7cd4431d-45c6-402f-af2c-8ba8b5d79996-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:20 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-7cd4431d-45c6-402f-af2c-8ba8b5d79996-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Creating offline snapshot f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 of volume c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[76201ddd-7b62-413f-a16c-9cb539445225]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:20 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "cinder-quobyte-7cd4431d-45c6-402f-af2c-8ba8b5d79996" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-7cd4431d-45c6-402f-af2c-8ba8b5d79996" acquired by "delete_volume" :: waited 0.073s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a09c4b-b2d1-405f-abc9-209af27d953d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445" returned: 0 in 0.662s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:21 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=158, name=volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 1G" returned: 0 in 0.354s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c83ac43c-a5de-45d9-b7b3-80058312a445 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996" returned: 0 in 0.692s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] CMD "qemu-img rebase -u -b volume-c83ac43c-a5de-45d9-b7b3-80058312a445 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135" returned: 0 in 0.323s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:21 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:47:21 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-7cd4431d-45c6-402f-af2c-8ba8b5d79996" returned: 0 in 0.306s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:22 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-quobyte-7cd4431d-45c6-402f-af2c-8ba8b5d79996" released by "delete_volume" :: held 1.262s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135" returned: 0 in 0.485s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:22 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:47:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135" returned: 0 in 0.348s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:22 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.info" returned: 0 in 0.387s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:23 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (7818a2ed-76d6-4e1e-9821-2a6da65e3c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d6665b-d13b-4c40-82b3-c8f2eb2e55a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Created reservations ['59e1826d-595f-4fc2-a76b-a566b986ff52', '4b25326f-e8ca-4bc4-991a-34aaa6fe16ed', '3f569717-e3c9-4672-b744-eda527b55ad8', '3e8ccbb1-6940-4764-8ce7-bf9942d7f15c'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.info" returned: 0 in 0.529s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.463s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d6665b-d13b-4c40-82b3-c8f2eb2e55a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1471510384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e45b62-0f69-4130-bb02-0d2a6968bb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:23Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98fc4b0-51ee-490b-88d5-afdfb859a58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98fc4b0-51ee-490b-88d5-afdfb859a58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5dacbdd-a969-4b57-9b1c-b322dd5d59f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5dacbdd-a969-4b57-9b1c-b322dd5d59f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e45b62-0f69-4130-bb02-0d2a6968bb57', 'volume_name': 'volume-01e45b62-0f69-4130-bb02-0d2a6968bb57', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f62ac84-40fa-484d-8917-2a9e71f71f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f62ac84-40fa-484d-8917-2a9e71f71f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc4e626-b7ea-4380-af88-85a6bc2daf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:23 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume 01e45b62-0f69-4130-bb02-0d2a6968bb57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e45b62-0f69-4130-bb02-0d2a6968bb57', 'volume_size': 1}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1471510384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e45b62-0f69-4130-bb02-0d2a6968bb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:23Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Creating volume 01e45b62-0f69-4130-bb02-0d2a6968bb57 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:47:23 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:47:23 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:23 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=160, name=volume-01e45b62-0f69-4130-bb02-0d2a6968bb57, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 1073741824" returned: 0 in 0.451s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:24 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-27b09bf6-91e1-44a1-a8a8-b5175790923b tempest-SnapshotDependencyTests-1274203991 None] Create snapshot completed successfully
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57" returned: 0 in 0.387s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] <== create_volume: return (875ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc4e626-b7ea-4380-af88-85a6bc2daf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e45b62-0f69-4130-bb02-0d2a6968bb57', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4002e5-1cf8-4769-ac0d-c99f97c55c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:25 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 (01e45b62-0f69-4130-bb02-0d2a6968bb57): created successfully
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4002e5-1cf8-4769-ac0d-c99f97c55c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (7818a2ed-76d6-4e1e-9821-2a6da65e3c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.395s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:25 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-c9b234ba-0977-46d9-a9e3-86c89481f3f4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created volume successfully.
Sep 16 11:47:25 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Deleted volume successfully.
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-d1e83bc1-d0ed-42b0-a277-27b7bc1e3909 tempest-CreateVolumesFromSourceVolumeTest-45012093 None] Lock "cinder-7cd4431d-45c6-402f-af2c-8ba8b5d79996-delete_volume" released by "delete_volume" :: held 5.201s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:25 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Flow 'volume_create_manager' (fae859d1-758e-43ea-8e87-0dae34028744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f371b2-f5ce-4409-be5c-f05208ef4114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f371b2-f5ce-4409-be5c-f05208ef4114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19883f0-a0be-4fc2-9b12-1ee800a63bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05bf2b6ab0b142588cfbe9916dab0c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6bffd96-cd9d-43d6-b971-8f2d9bd5f135,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:25Z,use_quota=True,user_id='acf354106aee4872a7c1a658bf95f3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0f477d-8aed-48fd-95f0-e96f03795ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0f477d-8aed-48fd-95f0-e96f03795ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11998eb-bc74-4875-9cdb-bd4c8cf3dc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c11998eb-bc74-4875-9cdb-bd4c8cf3dc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c19883f0-a0be-4fc2-9b12-1ee800a63bbe', 'volume_name': 'volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe', 'volume_size': 1, 'snapshot_id': 'f6bffd96-cd9d-43d6-b971-8f2d9bd5f135'}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e62b751-632f-4a82-8fa2-30906ab6d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e62b751-632f-4a82-8fa2-30906ab6d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f12679-ca47-4a63-87f2-e1f229b7e1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:25 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Volume c19883f0-a0be-4fc2-9b12-1ee800a63bbe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe', 'volume_size': 1, 'snapshot_id': 'f6bffd96-cd9d-43d6-b971-8f2d9bd5f135'}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "cinder-quobyte-f6bffd96-cd9d-43d6-b971-8f2d9bd5f135-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" by "_create_volume_from_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-f6bffd96-cd9d-43d6-b971-8f2d9bd5f135-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Creating volume c19883f0-a0be-4fc2-9b12-1ee800a63bbe from snapshot f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 {{(pid=83386) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "cinder-quobyte-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" by "_copy_volume_from_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] snapshot: f6bffd96-cd9d-43d6-b971-8f2d9bd5f135, volume: c19883f0-a0be-4fc2-9b12-1ee800a63bbe,  {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3416c6-3c81-48e1-83d0-c3c5da246cc5]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:25 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:26 devstack quobyte-client[83411]: System call of process 101436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.309s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135" returned: 0 in 0.851s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c83ac43c-a5de-45d9-b7b3-80058312a445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] will copy from snapshot at /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Creating direct copy from snapshot {{(pid=83386) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfea81b5-a857-407f-b52f-36abf401db7d]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:27 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445" returned: 0 in 0.867s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:27 devstack cinder-volume[83386]: DEBUG cinder.utils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe not found in is_blk_device check {{(pid=83386) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 16 11:47:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:27 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=161, name=volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" returned: 0 in 7.657s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:35 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[995e446d-00c4-4ff8-b2e5-3f8b7b89f2a2]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445" returned: 0 in 0.634s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Image conversion details: src /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445, size 1024.00 MB, duration 7.69 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:47:36 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Converted 1024.00 MB image at 133.13 MB/s
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" returned: 0 in 0.115s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" released by "_copy_volume_from_snapshot" :: held 10.533s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-f6bffd96-cd9d-43d6-b971-8f2d9bd5f135-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" released by "_create_volume_from_snapshot" :: held 10.575s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.603s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:SELECT=60,cinder:UPDATE=109,cinder:DELETE=9,cinder:INSERT=22 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=123,cinder:SELECT=86,cinder:DELETE=16,cinder:INSERT=22 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Creating offline snapshot ea16fd12-1986-4fac-a45c-9260bb29b404 of volume 01e45b62-0f69-4130-bb02-0d2a6968bb57 {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f12679-ca47-4a63-87f2-e1f229b7e1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe', 'volume_size': 1, 'snapshot_id': 'f6bffd96-cd9d-43d6-b971-8f2d9bd5f135'}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fefb6cd-c60a-4113-b36a-b2a534c7d566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d60c79-201e-443e-849a-12cd95a57b68]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:37 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Volume volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe (c19883f0-a0be-4fc2-9b12-1ee800a63bbe): created successfully
Sep 16 11:47:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fefb6cd-c60a-4113-b36a-b2a534c7d566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:37 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Flow 'volume_create_manager' (fae859d1-758e-43ea-8e87-0dae34028744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-cfa42664-308d-4321-b412-a4fea0a3cde6 tempest-SnapshotDependencyTests-1274203991 None] Created volume successfully.
Sep 16 11:47:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57" returned: 0 in 0.638s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:37 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=162, name=volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404 1G" returned: 0 in 0.275s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): qemu-img rebase -u -b volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "cinder-f6bffd96-cd9d-43d6-b971-8f2d9bd5f135-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "qemu-img rebase -u -b volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404" returned: 0 in 0.397s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:47:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-f6bffd96-cd9d-43d6-b971-8f2d9bd5f135-delete_snapshot" acquired by "delete_snapshot" :: waited 0.525s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:38 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:38 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "cinder-quobyte-c83ac43c-a5de-45d9-b7b3-80058312a445" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404" returned: 0 in 0.441s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:38 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:47:38 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:38 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:38 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Flow 'volume_create_manager' (5a5584f7-a09f-46b2-bd0a-bff131fa7a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2deb3141-b6a2-4c28-87ea-cf2850451c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-c83ac43c-a5de-45d9-b7b3-80058312a445" acquired by "delete_snapshot" :: waited 0.489s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "cinder-quobyte-f6bffd96-cd9d-43d6-b971-8f2d9bd5f135" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404" returned: 0 in 0.531s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2deb3141-b6a2-4c28-87ea-cf2850451c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c330d3-b502-4b54-bf33-cfc0ade96015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420614314d854f199561420464a5549c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:38Z,use_quota=True,user_id='526246ac5e1e4e72bf35fe4b7e1d102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c1ec3b-b6b9-4ae4-a0ed-844ac935d506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c1ec3b-b6b9-4ae4-a0ed-844ac935d506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d05ccd-69ac-47d4-a26f-fdff7987310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.info" returned: 0 in 0.252s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-f6bffd96-cd9d-43d6-b971-8f2d9bd5f135" acquired by "_delete_snapshot" :: waited 0.637s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Deleting offline snapshot f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 of volume c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] snapshot_file for this snap is: volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[869afb04-3ba0-4067-99fc-347e4e4cebfb]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:39 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.info" returned: 0 in 0.545s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.544s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d05ccd-69ac-47d4-a26f-fdff7987310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38c330d3-b502-4b54-bf33-cfc0ade96015', 'volume_name': 'volume-38c330d3-b502-4b54-bf33-cfc0ade96015', 'volume_size': 1, 'image_id': '7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'adaec3e86a01efb79c87e05e57067447', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '420614314d854f199561420464a5549c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0855c49535d849c163a8d73e02d88a25ab7e904c273f89922da3fe3378d5807a31bba338bc5068165855a5df945abd0ebc14517c80a1787c201e893e7a7e392c', 'id': '7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7', 'created_at': datetime.datetime(2025, 9, 16, 9, 47, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 9, 47, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8931c58d0>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e141a8-1be7-484c-8615-0b823b36bb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e141a8-1be7-484c-8615-0b823b36bb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6475bc-e0b5-4a7d-a84e-015e4ed5c271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:40 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Volume 38c330d3-b502-4b54-bf33-cfc0ade96015: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38c330d3-b502-4b54-bf33-cfc0ade96015', 'volume_size': 1, 'image_id': '7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'adaec3e86a01efb79c87e05e57067447', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '420614314d854f199561420464a5549c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0855c49535d849c163a8d73e02d88a25ab7e904c273f89922da3fe3378d5807a31bba338bc5068165855a5df945abd0ebc14517c80a1787c201e893e7a7e392c', 'id': '7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7', 'created_at': datetime.datetime(2025, 9, 16, 9, 47, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 9, 47, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8931c58d0>}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Cloning 38c330d3-b502-4b54-bf33-cfc0ade96015 from image 7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7  at location (None, None). {{(pid=83386) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135" returned: 0 in 0.668s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c83ac43c-a5de-45d9-b7b3-80058312a445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89901ce-c8bf-45d3-b0d5-7b719ae8a065]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:40 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-088f1f6b-4c2c-49d3-a82e-fc95145c08b6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Create snapshot completed successfully
Sep 16 11:47:40 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 16 11:47:40 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Image download 0.00 MB at 0.00 MB/s
Sep 16 11:47:41 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aa6317-3649-4d18-8951-d2968cbda04d]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445" returned: 0 in 0.622s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:41 devstack quobyte-client[83411]: System call of process 101481 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:47:41 devstack sudo[101478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD
Sep 16 11:47:41 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:47:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135" returned: 0 in 0.396s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:41 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445.f6bffd96-cd9d-43d6-b971-8f2d9bd5f135" returned: 0 in 0.233s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-f6bffd96-cd9d-43d6-b971-8f2d9bd5f135" released by "_delete_snapshot" :: held 2.262s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-c83ac43c-a5de-45d9-b7b3-80058312a445" released by "delete_snapshot" :: held 2.931s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:42 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (1bea8026-d527-4b79-afe3-7c5faf876f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0580c5b1-76d4-4594-ae68-5ec3c5cce978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Created reservations ['0bfc6b07-44ff-4eb1-9342-41a8da708029', '0c586120-8b36-42c8-ab17-c1220c3bac7f', '0b6b967e-09cb-4467-a36c-cc34e6c37c08', '319f7fff-2ef6-45f7-b48e-21df6914d423'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0580c5b1-76d4-4594-ae68-5ec3c5cce978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1143318181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c583ff-d264-4262-a2a1-c794351db069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:42Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2e0fd8-a66e-41f3-b2f0-fa94d160eb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2e0fd8-a66e-41f3-b2f0-fa94d160eb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48cb335e-d547-4c30-81fe-499712536076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48cb335e-d547-4c30-81fe-499712536076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c583ff-d264-4262-a2a1-c794351db069', 'volume_name': 'volume-c4c583ff-d264-4262-a2a1-c794351db069', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19303795-3332-409d-b555-7391ef39eb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19303795-3332-409d-b555-7391ef39eb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4b2f8e-3a29-4c31-8880-88d59d33bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:42 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume c4c583ff-d264-4262-a2a1-c794351db069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c583ff-d264-4262-a2a1-c794351db069', 'volume_size': 1}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1143318181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c583ff-d264-4262-a2a1-c794351db069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:42Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Creating volume c4c583ff-d264-4262-a2a1-c794351db069 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:47:42 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:47:42 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c4c583ff-d264-4262-a2a1-c794351db069 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:43 devstack quobyte-client[83411]: System call of process 101487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:47:43 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=164, name=volume-c4c583ff-d264-4262-a2a1-c794351db069, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:43 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "cinder-c83ac43c-a5de-45d9-b7b3-80058312a445-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c4c583ff-d264-4262-a2a1-c794351db069 1073741824" returned: 0 in 0.827s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:43 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c4c583ff-d264-4262-a2a1-c794351db069 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:44 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-c83ac43c-a5de-45d9-b7b3-80058312a445-delete_volume" acquired by "delete_volume" :: waited 0.680s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:44 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:44 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:47:44 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root
Sep 16 11:47:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (4d0be489-9d34-45ae-8d30-97ab2cdd1fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:44 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9cc793-ba4d-4312-8570-0fcc8508ec34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD" returned: 0 in 3.766s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c4c583ff-d264-4262-a2a1-c794351db069" returned: 0 in 0.974s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:44 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Delete snapshot completed successfully.
Sep 16 11:47:44 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] <== create_volume: return (2259ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:45 devstack sudo[101493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9cc793-ba4d-4312-8570-0fcc8508ec34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-849142787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e24b6b-0506-4972-8331-1e20da12d40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:43Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:45 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c99c4ff-bd9f-4e9f-bf3a-a2ab048fa782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c99c4ff-bd9f-4e9f-bf3a-a2ab048fa782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533033f3-60f2-4f67-837d-2eee0ee82911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533033f3-60f2-4f67-837d-2eee0ee82911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e24b6b-0506-4972-8331-1e20da12d40d', 'volume_name': 'volume-24e24b6b-0506-4972-8331-1e20da12d40d', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf845c11-6fa0-42f3-9391-994a6ff795ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf845c11-6fa0-42f3-9391-994a6ff795ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fd2a8b-0bcc-4683-8ba2-fa0d7f14c5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:45 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume 24e24b6b-0506-4972-8331-1e20da12d40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e24b6b-0506-4972-8331-1e20da12d40d', 'volume_size': 1}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-849142787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e24b6b-0506-4972-8331-1e20da12d40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:43Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Creating volume 24e24b6b-0506-4972-8331-1e20da12d40d {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:47:45 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-24e24b6b-0506-4972-8331-1e20da12d40d 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:45 devstack quobyte-client[83411]: System call of process 101495 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:47:45 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:45 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=165, name=volume-24e24b6b-0506-4972-8331-1e20da12d40d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:47:45 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (2fdb287e-98f9-45e7-bdb7-867778c25fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29a787a-84bb-49f2-8a16-62e0d91f2add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-b415bf25-68da-4703-a0bf-f67ba46497b0 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-f6bffd96-cd9d-43d6-b971-8f2d9bd5f135-delete_snapshot" released by "delete_snapshot" :: held 7.688s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4b2f8e-3a29-4c31-8880-88d59d33bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c583ff-d264-4262-a2a1-c794351db069', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2de9be-2dda-41b4-aaaf-d4a1a009a771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:46 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "cinder-quobyte-c83ac43c-a5de-45d9-b7b3-80058312a445" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29a787a-84bb-49f2-8a16-62e0d91f2add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-660860450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:44Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ebac26-150e-4baf-8f0f-83c38ff49b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ebac26-150e-4baf-8f0f-83c38ff49b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7c926a-8324-44ed-86a8-8b7451111c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7c926a-8324-44ed-86a8-8b7451111c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19', 'volume_name': 'volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5ff14f-6d9b-48ee-a44b-904af3f47745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5ff14f-6d9b-48ee-a44b-904af3f47745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8af6215-193f-487b-b7aa-0b022aa7a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:46 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume 6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19', 'volume_size': 1}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-24e24b6b-0506-4972-8331-1e20da12d40d 1073741824" returned: 0 in 0.891s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-24e24b6b-0506-4972-8331-1e20da12d40d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:46 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (da9e27b9-b092-43d3-b976-64738c432b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:46 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62716f51-f6ca-4071-8ab6-d9b2aebaf784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:47 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume volume-c4c583ff-d264-4262-a2a1-c794351db069 (c4c583ff-d264-4262-a2a1-c794351db069): created successfully
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2de9be-2dda-41b4-aaaf-d4a1a009a771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (1bea8026-d527-4b79-afe3-7c5faf876f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-c83ac43c-a5de-45d9-b7b3-80058312a445" acquired by "delete_volume" :: waited 0.716s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:47 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (8020471c-06b7-4778-b040-550d30f4de9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5322d8d7-1afc-478e-9e26-cb99c22d208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bea3af3-3b91-4a66-ac22-4f51680981c6]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-24e24b6b-0506-4972-8331-1e20da12d40d" returned: 0 in 0.719s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] <== create_volume: return (1784ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-660860450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:44Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Creating volume 6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:47:47 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:47:47 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:48 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root
Sep 16 11:47:48 devstack quobyte-client[83411]: System call of process 101503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:47:48 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=166, name=volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62716f51-f6ca-4071-8ab6-d9b2aebaf784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203968466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c9c684-aba0-4b26-8531-c829f0205281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:45Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8645b9-d4e4-49f6-9ba5-75a87d2c5cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8645b9-d4e4-49f6-9ba5-75a87d2c5cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df0d624-623b-4df0-a10a-97ef7bc314e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df0d624-623b-4df0-a10a-97ef7bc314e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46c9c684-aba0-4b26-8531-c829f0205281', 'volume_name': 'volume-46c9c684-aba0-4b26-8531-c829f0205281', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc95971-5c1d-4bae-9e08-8b696278f292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc95971-5c1d-4bae-9e08-8b696278f292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b9ef46-e6f4-4603-b8ba-4de49f201a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:48 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume 46c9c684-aba0-4b26-8531-c829f0205281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46c9c684-aba0-4b26-8531-c829f0205281', 'volume_size': 1}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fd2a8b-0bcc-4683-8ba2-fa0d7f14c5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e24b6b-0506-4972-8331-1e20da12d40d', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda05e29-5175-4166-96cc-5d98a1f53868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:48 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-8d53863a-1a0c-4c41-aa52-702fcfe16b53 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created volume successfully.
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD" returned: 1 in 3.734s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Temporary image 7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7 is fetched for user 526246ac5e1e4e72bf35fe4b7e1d102d. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5322d8d7-1afc-478e-9e26-cb99c22d208a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1028876054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0683a146-ec38-4803-a552-cf04f7e01bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:46Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529d61a7-0697-4b70-b271-d4b10dba45cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529d61a7-0697-4b70-b271-d4b10dba45cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52014194-8778-4234-ab35-f88a64e17acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52014194-8778-4234-ab35-f88a64e17acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0683a146-ec38-4803-a552-cf04f7e01bde', 'volume_name': 'volume-0683a146-ec38-4803-a552-cf04f7e01bde', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf051cd3-0ba4-493e-8f1c-d5aa51461df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf051cd3-0ba4-493e-8f1c-d5aa51461df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364bb77d-d1e1-4b09-a17f-738cda4cb7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:48 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume 0683a146-ec38-4803-a552-cf04f7e01bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0683a146-ec38-4803-a552-cf04f7e01bde', 'volume_size': 1}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445" returned: 0 in 1.436s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19 1073741824" returned: 0 in 0.868s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:48 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:49 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume volume-24e24b6b-0506-4972-8331-1e20da12d40d (24e24b6b-0506-4972-8331-1e20da12d40d): created successfully
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda05e29-5175-4166-96cc-5d98a1f53868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (4d0be489-9d34-45ae-8d30-97ab2cdd1fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:49 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-6fcceebb-e92f-4b10-8853-c74f8c0352c3 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created volume successfully.
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19" returned: 0 in 0.487s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c83ac43c-a5de-45d9-b7b3-80058312a445" returned: 0 in 0.726s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] <== create_volume: return (1558ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-203968466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46c9c684-aba0-4b26-8531-c829f0205281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:45Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Creating volume 46c9c684-aba0-4b26-8531-c829f0205281 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:47:49 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-46c9c684-aba0-4b26-8531-c829f0205281 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:49 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=167, name=volume-46c9c684-aba0-4b26-8531-c829f0205281, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-c83ac43c-a5de-45d9-b7b3-80058312a445" released by "delete_volume" :: held 2.765s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:49 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8af6215-193f-487b-b7aa-0b022aa7a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b093744-5f51-457d-af8c-72010530489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f163e8c1-b091-441f-a9e7-4052a2bee905]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-46c9c684-aba0-4b26-8531-c829f0205281 1073741824" returned: 0 in 0.809s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-46c9c684-aba0-4b26-8531-c829f0205281 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:50 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19 (6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19): created successfully
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b093744-5f51-457d-af8c-72010530489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:50 devstack sudo[101515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (2fdb287e-98f9-45e7-bdb7-867778c25fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:50 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:47:50 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5d9cc988-b431-459e-866d-0b4200434ac8 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created volume successfully.
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-46c9c684-aba0-4b26-8531-c829f0205281" returned: 0 in 0.536s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] <== create_volume: return (1402ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.228s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1028876054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0683a146-ec38-4803-a552-cf04f7e01bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43fbafa6b1db4fe2be57616c6dd892ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:46Z,use_quota=True,user_id='b43e8c41e3a4439c9fbd90893b5397c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Creating volume 0683a146-ec38-4803-a552-cf04f7e01bde {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:47:50 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:47:50 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0683a146-ec38-4803-a552-cf04f7e01bde 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:51 devstack quobyte-client[83411]: System call of process 101518 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:47:51 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=168, name=volume-0683a146-ec38-4803-a552-cf04f7e01bde, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b9ef46-e6f4-4603-b8ba-4de49f201a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46c9c684-aba0-4b26-8531-c829f0205281', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d64745d-c371-4742-9473-cd14abd228af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:51 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume volume-46c9c684-aba0-4b26-8531-c829f0205281 (46c9c684-aba0-4b26-8531-c829f0205281): created successfully
Sep 16 11:47:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d64745d-c371-4742-9473-cd14abd228af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:51 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (da9e27b9-b092-43d3-b976-64738c432b93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0683a146-ec38-4803-a552-cf04f7e01bde 1073741824" returned: 0 in 0.703s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:51 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0683a146-ec38-4803-a552-cf04f7e01bde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:51 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Created reservations ['54bd4f75-9cdf-429c-9b35-d3089eb6ffa1', '3702956a-2d7d-4447-87e0-2a92654324cb', 'fdb701a3-df5d-489e-835d-43f6309e9147', '1b4077df-4c06-468f-8234-be566e748c12'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:52 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-7ab6b775-ea31-4b63-a4e3-1cb379f8cae4 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created volume successfully.
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0683a146-ec38-4803-a552-cf04f7e01bde" returned: 0 in 0.439s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] <== create_volume: return (1173ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364bb77d-d1e1-4b09-a17f-738cda4cb7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0683a146-ec38-4803-a552-cf04f7e01bde', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcb0452-5a68-424a-8a7c-0ac37d49d80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:47:52 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume volume-0683a146-ec38-4803-a552-cf04f7e01bde (0683a146-ec38-4803-a552-cf04f7e01bde): created successfully
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fcb0452-5a68-424a-8a7c-0ac37d49d80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Flow 'volume_create_manager' (8020471c-06b7-4778-b040-550d30f4de9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:47:52 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-eeb810a5-907d-459a-877e-a16553974d6b tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created volume successfully.
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.266s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:52 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:53 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Deleted volume successfully.
Sep 16 11:47:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "cinder-c19883f0-a0be-4fc2-9b12-1ee800a63bbe-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:53 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-0683a146-ec38-4803-a552-cf04f7e01bde-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:53 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD" returned: 0 in 3.967s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-0683a146-ec38-4803-a552-cf04f7e01bde-delete_volume" acquired by "delete_volume" :: waited 0.860s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-c19883f0-a0be-4fc2-9b12-1ee800a63bbe-delete_volume" acquired by "delete_volume" :: waited 1.096s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ab9577ee-395f-47c0-a849-be8805a3c482 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-c83ac43c-a5de-45d9-b7b3-80058312a445-delete_volume" released by "delete_volume" :: held 10.447s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:54 devstack sudo[101527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD
Sep 16 11:47:54 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 16 11:47:54 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-quobyte-0683a146-ec38-4803-a552-cf04f7e01bde" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:54 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "cinder-quobyte-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" acquired by "delete_volume" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-0683a146-ec38-4803-a552-cf04f7e01bde" acquired by "delete_volume" :: waited 0.073s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef49e2eb-8598-4764-977a-8b96e0aba1cb]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26ebb2e-7c3c-4ac6-9d45-4ab4fdb11911]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:54 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0683a146-ec38-4803-a552-cf04f7e01bde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:55 devstack quobyte-client[83411]: System call of process 101530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:47:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0683a146-ec38-4803-a552-cf04f7e01bde" returned: 0 in 0.754s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:55 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0683a146-ec38-4803-a552-cf04f7e01bde {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" returned: 0 in 1.040s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-0683a146-ec38-4803-a552-cf04f7e01bde" returned: 0 in 0.188s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-0683a146-ec38-4803-a552-cf04f7e01bde" released by "delete_volume" :: held 1.295s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:56 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" returned: 0 in 0.421s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:56 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-quobyte-c19883f0-a0be-4fc2-9b12-1ee800a63bbe" released by "delete_volume" :: held 1.612s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:56 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created reservations ['73356204-ebba-4429-8b20-60a00c79298e', '5657975a-fa43-413f-abfc-b8196d0a8def', 'e783d18c-7fa8-40ce-9109-587acec9888f', '5a790536-9c79-4ecb-9046-0dd6f31d290e'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:56 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Created reservations ['5ced36ec-b45b-4d9a-b2f8-366cfb088619', '4bef0b45-ec25-4bf1-99ca-0906872b130e', '2bae7b24-f16c-4144-8ce8-bca081228bc5', 'a4e1aaaa-496d-4896-a73f-db880392d6d2'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.285s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:57 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root
Sep 16 11:47:57 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Deleted volume successfully.
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD" returned: 1 in 3.539s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c330d3-b502-4b54-bf33-cfc0ade96015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='420614314d854f199561420464a5549c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:47:38Z,use_quota=True,user_id='526246ac5e1e4e72bf35fe4b7e1d102d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Creating volume 38c330d3-b502-4b54-bf33-cfc0ade96015 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:47:57 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:57 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:57 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=169, name=volume-38c330d3-b502-4b54-bf33-cfc0ade96015, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-025cb13b-e80a-4385-82c5-4cf7980ba1c5 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-0683a146-ec38-4803-a552-cf04f7e01bde-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-46c9c684-aba0-4b26-8531-c829f0205281-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 1073741824" returned: 0 in 0.710s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.602s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-46c9c684-aba0-4b26-8531-c829f0205281-delete_volume" acquired by "delete_volume" :: waited 0.318s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:58 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Deleted volume successfully.
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015" returned: 0 in 0.466s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] <== create_volume: return (1206ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-3b5b7d5b-ee94-4da2-bc56-5fd3361b5c51 tempest-SnapshotDependencyTests-1274203991 None] Lock "cinder-c19883f0-a0be-4fc2-9b12-1ee800a63bbe-delete_volume" released by "delete_volume" :: held 4.265s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:47:58 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Attempting download of 7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7 ((None, None)) to volume 38c330d3-b502-4b54-bf33-cfc0ade96015. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 16 11:47:59 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:47:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-quobyte-46c9c684-aba0-4b26-8531-c829f0205281" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:47:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3dda2b-c561-4bc3-88de-e1028c5d8637]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_6dikz2kn {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:59 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-46c9c684-aba0-4b26-8531-c829f0205281" acquired by "delete_volume" :: waited 0.186s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:47:59 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1b1a77-4a2c-40e1-8e6e-e1ac08b825eb]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:47:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-46c9c684-aba0-4b26-8531-c829f0205281 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:47:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_6dikz2kn" returned: 0 in 0.678s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:47:59 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_6dikz2kn {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-46c9c684-aba0-4b26-8531-c829f0205281" returned: 0 in 0.693s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-46c9c684-aba0-4b26-8531-c829f0205281 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-46c9c684-aba0-4b26-8531-c829f0205281" returned: 0 in 0.129s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:00 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-46c9c684-aba0-4b26-8531-c829f0205281" released by "delete_volume" :: held 1.176s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_6dikz2kn" returned: 1 in 0.889s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_6dikz2kn' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:48:00 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1737a81-21a8-4004-9726-bb9942b20fcd]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:00 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:01 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created reservations ['cce9c8ac-a91b-44e6-9156-af0fd6b89154', 'd0a40bf6-7783-41b4-b911-eaf4db2415cd', 'c3077533-8294-48af-b36b-3fc7d30f2697', 'ed15d8b1-cfef-4292-b288-f598cb91235f'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:48:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD" returned: 0 in 0.882s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:01 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD" returned: 1 in 0.609s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] 7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7 was raw, converting to raw {{(pid=83386) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.223s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:48:02 devstack quobyte-client[83411]: System call of process 101561 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:48:02 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Deleted volume successfully.
Sep 16 11:48:02 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=169, name=volume-38c330d3-b502-4b54-bf33-cfc0ade96015, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015" returned: 0 in 0.308s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7_2u15s52ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 {{(pid=83386) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 16 11:48:02 devstack cinder-volume[83386]: INFO cinder.image.image_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Converted 0.00 MB image at 0.00 MB/s
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-520cfb33-bafc-4f33-896c-a6b17a1addb6 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-46c9c684-aba0-4b26-8531-c829f0205281-delete_volume" released by "delete_volume" :: held 4.254s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:02 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 1G" returned: 0 in 0.299s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:03 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a68784-965b-4ac6-ad61-feb59aedba09]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19-delete_volume" acquired by "delete_volume" :: waited 0.357s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:03 devstack quobyte-client[83411]: System call of process 101568 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:48:03 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:03 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-quobyte-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015" returned: 0 in 0.725s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:03 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:04 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19" acquired by "delete_volume" :: waited 0.399s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:04 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b8b964-6d50-4629-90f9-c46c0f3c9ea7]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015" returned: 1 in 0.946s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:04 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:48:04 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Downloaded image 7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7 ((None, None)) to volume 38c330d3-b502-4b54-bf33-cfc0ade96015 successfully. {{(pid=83386) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 16 11:48:04 devstack cinder-volume[83386]: DEBUG cinder.image.image_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Temporary image 7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7 for user 526246ac5e1e4e72bf35fe4b7e1d102d is deleted. {{(pid=83386) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 16 11:48:04 devstack cinder-volume[83386]: DEBUG cinder.volume.volume_utils [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Marking volume 38c330d3-b502-4b54-bf33-cfc0ade96015 as bootable. {{(pid=83386) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 16 11:48:05 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Copying metadata from image 7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7 to 38c330d3-b502-4b54-bf33-cfc0ade96015. {{(pid=83386) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 16 11:48:05 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Creating volume glance metadata for volume 38c330d3-b502-4b54-bf33-cfc0ade96015 backed by image 7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7 with: {'image_id': '7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'adaec3e86a01efb79c87e05e57067447', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83386) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 16 11:48:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19" returned: 0 in 0.852s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:05 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19" returned: 0 in 0.376s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:05 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19" released by "delete_volume" :: held 1.588s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6475bc-e0b5-4a7d-a84e-015e4ed5c271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c330d3-b502-4b54-bf33-cfc0ade96015', 'volume_size': 1, 'image_id': '7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'adaec3e86a01efb79c87e05e57067447', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '420614314d854f199561420464a5549c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0855c49535d849c163a8d73e02d88a25ab7e904c273f89922da3fe3378d5807a31bba338bc5068165855a5df945abd0ebc14517c80a1787c201e893e7a7e392c', 'id': '7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7', 'created_at': datetime.datetime(2025, 9, 16, 9, 47, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 9, 47, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b505a2e-f5aa-4ca7-aa39-1c28f69d64f7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7ff8931c58d0>}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:05 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c7919d-d3c0-455e-8bd2-164baf541f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:06 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Volume volume-38c330d3-b502-4b54-bf33-cfc0ade96015 (38c330d3-b502-4b54-bf33-cfc0ade96015): created successfully
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c7919d-d3c0-455e-8bd2-164baf541f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Flow 'volume_create_manager' (5a5584f7-a09f-46b2-bd0a-bff131fa7a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created reservations ['8e6c6140-6f5f-4235-8ec6-98826e419fbd', 'e5356fc0-d1df-4352-9bf1-486c4b7a6084', 'df4f88f4-98d5-4533-b078-e81b767bdb2f', '3b98a1fe-913e-4164-9854-b1eef88508d3'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:48:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-cd49b454-d877-4fb3-b809-8de1fe8bfd6f tempest-VolumeImageDependencyTests-996543163 None] Created volume successfully.
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.177s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:48:06 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Deleted volume successfully.
Sep 16 11:48:06 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-24e24b6b-0506-4972-8331-1e20da12d40d-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-24e24b6b-0506-4972-8331-1e20da12d40d-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-55dd3ccb-76a8-4831-aa10-1d2063655e40 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-6ca9f0a6-d3dc-43c6-880f-7fbdcc78ca19-delete_volume" released by "delete_volume" :: held 3.709s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:07 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-quobyte-24e24b6b-0506-4972-8331-1e20da12d40d" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Acquiring lock "cinder-38c330d3-b502-4b54-bf33-cfc0ade96015-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-24e24b6b-0506-4972-8331-1e20da12d40d" acquired by "delete_volume" :: waited 0.030s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:07 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Lock "cinder-38c330d3-b502-4b54-bf33-cfc0ade96015-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:07 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c4acc-9346-4890-a905-95a83bf63e7c]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:07 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-24e24b6b-0506-4972-8331-1e20da12d40d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:08 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Acquiring lock "cinder-quobyte-38c330d3-b502-4b54-bf33-cfc0ade96015" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-24e24b6b-0506-4972-8331-1e20da12d40d" returned: 0 in 0.988s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-24e24b6b-0506-4972-8331-1e20da12d40d {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Lock "cinder-quobyte-38c330d3-b502-4b54-bf33-cfc0ade96015" acquired by "delete_volume" :: waited 0.234s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-24e24b6b-0506-4972-8331-1e20da12d40d" returned: 0 in 0.243s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:08 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[533bb86c-ed52-455b-8d3e-e8ee291192ce]: (4, 'raw') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:08 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:08 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-24e24b6b-0506-4972-8331-1e20da12d40d" released by "delete_volume" :: held 1.534s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015" returned: 0 in 0.635s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:09 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created reservations ['fc0a597e-375f-40be-b9d1-25cdc8b98d2e', '481273a4-bd22-472c-b0ae-f9dbab468174', 'bbf63d58-000b-4091-bf2d-08827d6f6dca', '02c37561-bcc7-4f2e-8d64-b5baf4f8b7a1'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:48:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:09 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:10 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015" returned: 1 in 0.817s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015' failed. Not Retrying. {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 16 11:48:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:10 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-c4c583ff-d264-4262-a2a1-c794351db069-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:10 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-38c330d3-b502-4b54-bf33-cfc0ade96015" returned: 0 in 0.493s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:10 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-c4c583ff-d264-4262-a2a1-c794351db069-delete_volume" acquired by "delete_volume" :: waited 0.243s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.981s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:48:11 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Deleted volume successfully.
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Lock "cinder-quobyte-38c330d3-b502-4b54-bf33-cfc0ade96015" released by "delete_volume" :: held 2.527s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-87d6716c-74c9-4931-8f1f-43c10635ae13 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-24e24b6b-0506-4972-8331-1e20da12d40d-delete_volume" released by "delete_volume" :: held 4.086s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:11 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-quobyte-c4c583ff-d264-4262-a2a1-c794351db069" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-c4c583ff-d264-4262-a2a1-c794351db069" acquired by "delete_volume" :: waited 0.049s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e5dbf1-47c2-4cef-82b0-cbfcf7dfa26c]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c4c583ff-d264-4262-a2a1-c794351db069 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Created reservations ['358dfa7e-07d1-4a48-9d58-e73281e83c3b', '142c2546-39a5-451e-b5c3-974865b018fc', '1f2876bd-371f-44e7-8bdb-902a05598888', '8e0de642-1fc7-4685-881e-1eb7c1f095cf'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:11 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:12 devstack quobyte-client[83411]: System call of process 101598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:48:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.259s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c4c583ff-d264-4262-a2a1-c794351db069" returned: 0 in 0.822s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:12 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:48:12 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Deleted volume successfully.
Sep 16 11:48:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c4c583ff-d264-4262-a2a1-c794351db069 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:12 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-c4c583ff-d264-4262-a2a1-c794351db069" returned: 0 in 0.601s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-37c8ad40-15db-49d7-944a-e6f326d572c1 tempest-VolumeImageDependencyTests-996543163 None] Lock "cinder-38c330d3-b502-4b54-bf33-cfc0ade96015-delete_volume" released by "delete_volume" :: held 5.679s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:13 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-c4c583ff-d264-4262-a2a1-c794351db069" released by "delete_volume" :: held 1.782s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:13 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created reservations ['35c40007-c39e-4596-959e-9039f6021d6d', '43a7096b-91a2-4be6-8e74-eb5594ce4250', '6349ff56-9754-4861-a76d-d61b3b1ad6e7', '4cdcaead-4efa-4e92-85cc-4ea203ef57fb'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:48:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:13 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:13 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:14 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.311s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:14 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:48:14 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Deleted volume successfully.
Sep 16 11:48:14 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-c6f6e8b6-1392-4272-baea-6399e9c7789a tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-c4c583ff-d264-4262-a2a1-c794351db069-delete_volume" released by "delete_volume" :: held 3.906s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-ea16fd12-1986-4fac-a45c-9260bb29b404-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-ea16fd12-1986-4fac-a45c-9260bb29b404-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:15 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-quobyte-01e45b62-0f69-4130-bb02-0d2a6968bb57" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-01e45b62-0f69-4130-bb02-0d2a6968bb57" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-quobyte-ea16fd12-1986-4fac-a45c-9260bb29b404" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-ea16fd12-1986-4fac-a45c-9260bb29b404" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Deleting offline snapshot ea16fd12-1986-4fac-a45c-9260bb29b404 of volume 01e45b62-0f69-4130-bb02-0d2a6968bb57 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] snapshot_file for this snap is: volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[276c9d69-9faa-4566-8be4-28c1938cc510]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:15 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404" returned: 0 in 0.639s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:16 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e45b62-0f69-4130-bb02-0d2a6968bb57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:48:16 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1c26da-fffd-49c9-86cd-6b84342dd0f3]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57" returned: 0 in 0.596s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:16 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404" returned: 0 in 0.303s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:17 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57.ea16fd12-1986-4fac-a45c-9260bb29b404" returned: 0 in 0.176s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-ea16fd12-1986-4fac-a45c-9260bb29b404" released by "_delete_snapshot" :: held 2.259s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:17 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-01e45b62-0f69-4130-bb02-0d2a6968bb57" released by "delete_snapshot" :: held 2.305s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:17 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created reservations ['019ebadc-1f7c-4dfe-937c-7473ffb377e4', 'da4e2f39-52ac-4d2e-844d-b24f9342f1b6', '742e766e-7c1d-4a3b-b85b-fcec68f10fcb', 'e14fd088-7e38-4ac6-a72d-cd2372cdaad9'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:48:18 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Delete snapshot completed successfully.
Sep 16 11:48:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ee8f3b8b-0fb3-4afa-9df5-1216f9984c49 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-ea16fd12-1986-4fac-a45c-9260bb29b404-delete_snapshot" released by "delete_snapshot" :: held 2.901s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-01e45b62-0f69-4130-bb02-0d2a6968bb57-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-01e45b62-0f69-4130-bb02-0d2a6968bb57-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:18 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "cinder-quobyte-01e45b62-0f69-4130-bb02-0d2a6968bb57" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:18 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-01e45b62-0f69-4130-bb02-0d2a6968bb57" acquired by "delete_volume" :: waited 0.015s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:18 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecd9451-5c7c-4b0c-b575-a3b68da2190c]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:18 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57" returned: 0 in 0.482s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:19 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e45b62-0f69-4130-bb02-0d2a6968bb57" returned: 0 in 0.116s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:19 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-quobyte-01e45b62-0f69-4130-bb02-0d2a6968bb57" released by "delete_volume" :: held 0.839s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:19 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Created reservations ['24644897-430f-46f3-8796-49f71bdfd0ec', '9cbb1f4c-4a6b-45fa-ac18-376d8a93a240', '479d5317-a3f1-42bc-94bd-c52c869d1a8f', '7a677ac0-ae91-4ee6-b09a-17ef9cf82adf'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:48:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:20 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:20 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.082s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:20 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:48:20 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Deleted volume successfully.
Sep 16 11:48:20 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-ef8a751a-02c1-4c33-b632-48da40f95b99 tempest-CreateVolumesFromSnapshotTest-1537685942 None] Lock "cinder-01e45b62-0f69-4130-bb02-0d2a6968bb57-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:24 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Flow 'volume_create_manager' (aa0d5855-7bba-4f2a-8031-eb897f030780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9871fb-3979-40e5-8131-e3592f98d448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9871fb-3979-40e5-8131-e3592f98d448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e30da3-fea4-4b39-b0b3-65d707a1edd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247d2d33a99541918a2f9f2cc308d62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:48:24Z,use_quota=True,user_id='8069dce1fd3d422682f49a34242f73d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80961d79-7ac6-4f7f-a616-6c40a64309de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80961d79-7ac6-4f7f-a616-6c40a64309de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e58a2a-ee59-47c4-a515-df518cc5d3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e58a2a-ee59-47c4-a515-df518cc5d3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e30da3-fea4-4b39-b0b3-65d707a1edd0', 'volume_name': 'volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364834f7-7a41-4d97-a3ca-6412960a8559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364834f7-7a41-4d97-a3ca-6412960a8559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c78b2ad-e2fd-4140-af11-e38c495289f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:24 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Volume 01e30da3-fea4-4b39-b0b3-65d707a1edd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0', 'volume_size': 1}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e30da3-fea4-4b39-b0b3-65d707a1edd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247d2d33a99541918a2f9f2cc308d62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:48:24Z,use_quota=True,user_id='8069dce1fd3d422682f49a34242f73d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Creating volume 01e30da3-fea4-4b39-b0b3-65d707a1edd0 {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:48:24 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:24 devstack quobyte-client[83411]: System call of process 101655 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:48:24 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=170, name=volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0 1073741824" returned: 0 in 0.341s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0" returned: 0 in 0.086s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] <== create_volume: return (493ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:48:24 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.505s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c78b2ad-e2fd-4140-af11-e38c495289f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d947bcb5-a104-46f1-b0f3-9ca23b3c302a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:25 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Volume volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0 (01e30da3-fea4-4b39-b0b3-65d707a1edd0): created successfully
Sep 16 11:48:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d947bcb5-a104-46f1-b0f3-9ca23b3c302a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:25 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Flow 'volume_create_manager' (aa0d5855-7bba-4f2a-8031-eb897f030780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:48:25 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-9e6fafe5-4f71-41a8-80b6-290b7660630a tempest-CinderUnicodeTest-845836100 None] Created volume successfully.
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG oslo_service.periodic_task [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83386) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.109s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-6ecbb9bc-d756-417c-b573-e59a70a806a8 None None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:48:26 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83386) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}}
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Flow 'volume_create_manager' (296c9fbf-2db8-4f89-b32b-517947930d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:48:26 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a873dbd2-e946-45ea-b5bb-5c7cb636fe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a873dbd2-e946-45ea-b5bb-5c7cb636fe22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:48:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-798026118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5904eed-f2b9-4446-a7ff-2ff14a7b634e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247d2d33a99541918a2f9f2cc308d62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:48:27Z,use_quota=True,user_id='8069dce1fd3d422682f49a34242f73d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec158f7-710f-43ad-bd51-a1bb74bfebe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec158f7-710f-43ad-bd51-a1bb74bfebe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35d2d34-c049-4284-acdc-de93e40b99c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35d2d34-c049-4284-acdc-de93e40b99c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5904eed-f2b9-4446-a7ff-2ff14a7b634e', 'volume_name': 'volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892a51bb-cb5e-4dd0-a2f5-1250f7357322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892a51bb-cb5e-4dd0-a2f5-1250f7357322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83389cf3-ee24-495e-a50a-17747162cf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:27 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Volume d5904eed-f2b9-4446-a7ff-2ff14a7b634e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e', 'volume_size': 1}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7ff89dc973a0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-16T09:48:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-798026118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5904eed-f2b9-4446-a7ff-2ff14a7b634e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247d2d33a99541918a2f9f2cc308d62e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T09:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T09:48:27Z,use_quota=True,user_id='8069dce1fd3d422682f49a34242f73d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0c970dc-2f21-4417-996f-cf0af3f4fefe),volume_type_id=b0c970dc-2f21-4417-996f-cf0af3f4fefe)}" {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Creating volume d5904eed-f2b9-4446-a7ff-2ff14a7b634e {{(pid=83386) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Selected 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd as target Quobyte volume. {{(pid=83386) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 16 11:48:27 devstack cinder-volume[83386]: INFO cinder.volume.drivers.remotefs [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] casted to 10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e 1073741824 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:27 devstack quobyte-client[83411]: System call of process 101660 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:48:27 devstack quobyte-client[83411]: System call of process 101660 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 16 11:48:27 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=171, name=volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e 1073741824" returned: 0 in 0.303s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" returned: 0 in 0.107s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] <== create_volume: return (479ms) {'provider_location': '10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'} {{(pid=83386) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.492s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83389cf3-ee24-495e-a50a-17747162cf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e', 'volume_size': 1}' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899b4d4b-4dd6-4f51-8e4d-ca24529e2667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 16 11:48:27 devstack cinder-volume[83386]: INFO cinder.volume.flows.manager.create_volume [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Volume volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e (d5904eed-f2b9-4446-a7ff-2ff14a7b634e): created successfully
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899b4d4b-4dd6-4f51-8e4d-ca24529e2667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83386) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 16 11:48:27 devstack cinder-volume[83386]: DEBUG cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Flow 'volume_create_manager' (296c9fbf-2db8-4f89-b32b-517947930d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83386) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 16 11:48:27 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-a86250a5-cd60-456b-a374-18ba7664b6dd tempest-CinderUnicodeTest-845836100 None] Created volume successfully.
Sep 16 11:48:29 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:29 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Creating offline snapshot 41c14acd-0ca8-422a-8128-0b40684dbbd4 of volume d5904eed-f2b9-4446-a7ff-2ff14a7b634e {{(pid=83386) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 16 11:48:29 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f0ec1a-ac3c-4b8a-a5ef-241453b562f4]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" returned: 0 in 0.417s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4 1G {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:29 devstack quobyte-client[83411]: The server volume:e598b538-60f2-42d4-adcd-54ff8f5431d9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=e598b538-60f2-42d4-adcd-54ff8f5431d9, inode=172, name=volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.148), requestorAccessMask=0
Sep 16 11:48:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4 1G" returned: 0 in 0.228s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:29 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] CMD "qemu-img rebase -u -b volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e -F qcow2 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4" returned: 0 in 0.149s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4 is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4" returned: 0 in 0.088s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Setting permissions: /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e -> 1000:1000 {{(pid=83386) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4" returned: 0 in 0.083s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.info" returned: 0 in 0.099s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] File path /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.info is being set with permissions: 660 {{(pid=83386) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.info {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.info" returned: 0 in 0.088s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:30 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.533s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:30 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-42047244-7ebc-49af-8971-b7ce47427997 tempest-CinderUnicodeTest-845836100 None] Create snapshot completed successfully
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Acquiring lock "cinder-41c14acd-0ca8-422a-8128-0b40684dbbd4-delete_snapshot" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Lock "cinder-41c14acd-0ca8-422a-8128-0b40684dbbd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:31 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Acquiring lock "cinder-quobyte-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" by "delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Lock "cinder-quobyte-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Acquiring lock "cinder-quobyte-41c14acd-0ca8-422a-8128-0b40684dbbd4" by "_delete_snapshot" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Lock "cinder-quobyte-41c14acd-0ca8-422a-8128-0b40684dbbd4" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Deleting offline snapshot 41c14acd-0ca8-422a-8128-0b40684dbbd4 of volume d5904eed-f2b9-4446-a7ff-2ff14a7b634e {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] snapshot_file for this snap is: volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4 {{(pid=83386) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3aea96-9c39-4c6a-b564-8f23169e3aa0]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4" returned: 0 in 0.412s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.remotefs [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83386) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[53372d25-96d6-4595-9550-7341f531cf23]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:31 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" returned: 0 in 0.397s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4" returned: 0 in 0.214s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:32 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e.41c14acd-0ca8-422a-8128-0b40684dbbd4" returned: 0 in 0.092s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Lock "cinder-quobyte-41c14acd-0ca8-422a-8128-0b40684dbbd4" released by "_delete_snapshot" :: held 1.418s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:32 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Lock "cinder-quobyte-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" released by "delete_snapshot" :: held 1.442s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:33 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Created reservations ['5e7eb2cd-11ec-4a9c-b56f-95dbf63a7dac', '3fc08db1-4478-492c-9951-dac3d0ff7fbc', 'ab6b3c4b-853d-4e40-8726-d987e19f1f95', 'bee5b638-870e-4dac-9bc6-51140e72689c'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:48:33 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Delete snapshot completed successfully.
Sep 16 11:48:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-1029f57a-779c-46aa-abb8-e385a686f94f tempest-CinderUnicodeTest-845836100 None] Lock "cinder-41c14acd-0ca8-422a-8128-0b40684dbbd4-delete_snapshot" released by "delete_snapshot" :: held 1.882s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Acquiring lock "cinder-d5904eed-f2b9-4446-a7ff-2ff14a7b634e-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Lock "cinder-d5904eed-f2b9-4446-a7ff-2ff14a7b634e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:33 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Acquiring lock "cinder-quobyte-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:33 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Lock "cinder-quobyte-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" acquired by "delete_volume" :: waited 0.026s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:33 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eedc66-8942-46c9-bac6-b89665215720]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:33 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" returned: 0 in 0.406s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" returned: 0 in 0.088s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Lock "cinder-quobyte-d5904eed-f2b9-4446-a7ff-2ff14a7b634e" released by "delete_volume" :: held 0.676s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Created reservations ['8379887c-a89e-4ee7-81ae-a7cf3ea3c9a5', '9921b46f-ae23-4aa6-936e-6a199317814a', '59fc97de-af99-4d30-b58f-f2a34746e882', '94d094b9-d290-4c64-8986-14a9d174d10c'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:34 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:35 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.087s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:35 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:48:35 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Deleted volume successfully.
Sep 16 11:48:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-5270a21a-30e6-4eed-989f-b67e5548ae4f tempest-CinderUnicodeTest-845836100 None] Lock "cinder-d5904eed-f2b9-4446-a7ff-2ff14a7b634e-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:35 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Acquiring lock "cinder-01e30da3-fea4-4b39-b0b3-65d707a1edd0-delete_volume" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Lock "cinder-01e30da3-fea4-4b39-b0b3-65d707a1edd0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:36 devstack cinder-volume[83386]: WARNING cinder.volume.volume_utils [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 16 11:48:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Acquiring lock "cinder-quobyte-01e30da3-fea4-4b39-b0b3-65d707a1edd0" by "delete_volume" {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 16 11:48:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Lock "cinder-quobyte-01e30da3-fea4-4b39-b0b3-65d707a1edd0" acquired by "delete_volume" :: waited 0.014s {{(pid=83386) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 16 11:48:36 devstack cinder-volume[83386]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4c89c6-4b8b-4a6f-8670-ee1db0380666]: (4, 'qcow2') {{(pid=84015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 16 11:48:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0" returned: 0 in 0.424s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:36 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] CMD "rm -f /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9/volume-01e30da3-fea4-4b39-b0b3-65d707a1edd0" returned: 0 in 0.122s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:36 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Lock "cinder-quobyte-01e30da3-fea4-4b39-b0b3-65d707a1edd0" released by "delete_volume" :: held 0.715s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=124,cinder:DELETE=11,cinder:SELECT=68,cinder:INSERT=28 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG cinder.quota [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Created reservations ['cf84fa01-70cd-4262-9cf1-23163a90e6fc', '6b48c126-47ae-4974-88bf-4c72b3663791', 'd8180a19-3b7c-49d7-a48c-9081b7b39694', '882bcf87-66b9-481a-9881-c9a687b87e5d'] {{(pid=83386) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=116,cinder:SELECT=99,cinder:DELETE=10,cinder:INSERT=37 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd': None} {{(pid=83386) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG cinder.volume.drivers.quobyte [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Available shares ['10.10.41.181/cinder-vol-8a417c6e-2da2-428c-a454-36df5af314bd'] {{(pid=83386) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.lockutils [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83386) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9 {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG oslo_concurrency.processutils [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/83847fb446c32a4dfbb591308e3120d9" returned: 0 in 0.128s {{(pid=83386) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG cinder.manager [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Notifying Schedulers of capabilities ... {{(pid=83386) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 16 11:48:37 devstack cinder-volume[83386]: INFO cinder.volume.manager [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Deleted volume successfully.
Sep 16 11:48:37 devstack cinder-volume[83386]: DEBUG cinder.coordination [None req-74bdcdbb-5648-456b-95f9-486d16ef4aa9 tempest-CinderUnicodeTest-845836100 None] Lock "cinder-01e30da3-fea4-4b39-b0b3-65d707a1edd0-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=83386) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 16 11:48:47 devstack cinder-volume[83386]: DEBUG dbcounter [-] [83386] Writing DB stats cinder:UPDATE=11,cinder:SELECT=2,cinder:DELETE=1 {{(pid=83386) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}